I feel one disclaimer that karpathy modestly left out is that he is perhaps one of the most successful PhD students in his field. This likely impacts his view of a PhD program. I personally survived a PhD myself (also in CS, also in ML, also in Computer Vision!), and I've passed through without so many warm, fuzzy feelings.