I've worked a lot from Live Linux USB sticks and the speed is not problematic. Typically in a Live environment everything is stored sequentially and on a compressed filesystem, which also helps. I've also run Linux completely from ram quite a few times which is really fast after the initial slow loading process (copying everything to ram takes awhile).