Well it depends... are you rebooting straight from the DVD/CD/USB or are you running it from within Windows. (Ubuntu has this feature)?
If you use the latter method... it could be traceable, granted the computer has software to log opened applications. (most keylogger software does this.)
But in general... no.. the only thing you need to worry about is getting caught in the process.