For some reason "so" used this way bothers me more than other fillers. Also, saying "sort of" something when you mean exactly that thing I also find very distracting.