Short Thoughts

Recently, I've become a huge fan of Andrej Karpathy after watching his 'Building Micrograd' lecture. The code he wrote for the neuron-layer-MLP was so clean and elegant. I know people always say Python is supposed to be readable, but honestly, I've never experienced anything quite like this before. On top of that, he is absolutely brilliant yet so down-to-earth. The difference between him and some of the 半瓶子醋 'experts' is 云泥之别. I actually first came across him on Bilibili in 2024 watching his intro to GPT. Later, I read 李飞飞's memoir, The Worlds I See. To be honest, I was a Fei-Fei fan first, haha! Then, by pure chance, I was blown away to discover that Fei-Fei was actually his PhD advisor. Small world!"

It may look like Google is lurking in the corner, staying out of the spotlight. But I think, they are the true powerhouse, because they've achieved full-stack vertical integration. They own the Cloud, the compute capacity, the TPU hardware, the algorithms, and the data. They are literally the only player that doesn't have to pay the 'Nvidia tax'—that's how integrated they are. In fact, the very reason they seem to lack presence in this space is because of that complete vertical closure. I believe the future belongs to Google. I'm not afraid to admit it: I've become a total Google fanboy."