The Ghost of Chips
Past, Present and Future
🔷 Subscribe to get breakdowns of the most important developments in AI in your inbox every morning.
Here’s today at a glance:
🎙️ EB-1: Jensenmath
EB-1, our very first podcast, dropped last week. Before I continue, the rules of the game are:
Pods that CHART stay alive
Pods that get a Follow on Apple Podcasts CHART
So FIRST, CLICK on the link below (opens up your Apple Podcasts app), and click “+Follow” (in the upper right-hand corner)
Emergent Behavior on Apple Podcasts
Technology · 2024
Then go ahead and listen to the podcast any way you want to on your preferred app, capiche mon ami?
Listen on
We Covered
OpenAI’s $7 trillion YOLO fundraising
Nvidia’s market position and its competitors
Nvidia’s promised 4x annual performance improvement
ASML’s monopoly position
Who
Dylan Patel (LinkedIn), founder of Semi Analysis, a semiconductor and AI research and consulting firm with analysts in the US, Taiwan, Japan, and Singapore.
When
Feb 15, 2024
Background
Dylan is one of the best-informed people in AI and semiconductors, and responsible for several of the major stories in the field over the last year, such as:
The GPU Rich/GPU Poor meme
Google Has No Moat memo
Breaking the comprehensive details of the GPT-4 architecture
Ate first met Dylan through false accusations:
Which Dylan easily refuted:
And hence began a curmudgeonly relationship of tweets and secret DMs (the best kind). Which naturally let to this pod.
🍪 Intel Made A Good Chip
Stability AI shares the performance of Intel’s Gaudi chip across its clusters, and it finally looks competitive.
That’s double the image training throughput of a H100. With an at minimum 33% lower cost than using H100s based on Databricks survey of the public cloud in January.
For inference, the cost advantage is even more pronounced, with almost a 50% cost advantage.
And of course, Gaudi 3 is coming in 2024.
All of which, must be making Jensen increasingly nervous. He says even free AI chips from his competitors can't beat Nvidia's GPUs,
Now, please note that none of this is financial advice. Warren Buffet brain would say “Buy Intel,” while Charlie Munger brain would say “Buy Nvidia," which just goes to show how bad all financial advice out there is.
Because truly, in an AGI world, the only thing worth anything is human relationships and health. So go out there and touch some grass on a walk with your family.
🗞️ Things Happen
GPT-5 now leaked
Don’t be pys-opped by Claude
🖼️ AI Artwork Of The Day
