TPUs, GPUs and the future of everything
I was listening to the ever interesting TBPN podcast earlier and realised I didn't really understand the difference between TPUs and GPUs. Armed with some wireless earbuds I got a few weeks ago I started up a voicechat with Gemini to get this figured out. One thing led to another and we fell into some civilization engineering, as one does, while eating breakfast these days.
Here is the full chat.
The speech to text transcription was a bit rubbish sometimes, but mostly Gemini got the gist of what I was saying. I had Gemini speaking the answers each time in a voice I had previously selected. I recommend doing the same and reading along.
It starts off quite technical, but rapidly gets very crazy from the perspective of the scale of things we are currently used to contemplating. I tried to keep things in some way grounded in reality by continually estimating key metrics. This will probably all be quite normal in a few weeks time.
It's wild, and it just keeps getting more wild. #