If you delete your prefetch folder contents you may notice some slowdowns when loading applications. Windows has to rebuilt all files from scratch. On the other hand, one can live happily without prefetching or, at least, prefetching boot loader only.