2024-01-23: Goalposts
In Artificial Intelligence and the Moving Of
🔷 Hey everyone, welcome to the first-ever edition of Emergent Behavior, a daily newsletter that translates what’s happening in the realm of artificial intelligence.
Here’s today at a glance:
💨 Meta joins the AGI chase
Zuck announced last week:
Meta has “long term goals of building general intelligence, open sourcing it responsibly, and making it available and useful to everyone in all of our daily lives”
They have 600,000 Nvidia H100 GPU equivalents of compute - to put this into perspective OpenAI’s GPT-4 was trained on 8,000 H100 GPUs for 100 days. Meta now has 75 times that number, with $10.5 billion of H100s alone.
They are training Llama 3 - the successor to the Meta’s popular open source language model Llama 2, which will presumably match OpenAI’s GPT-4. This puts the open source release of a GPT-4 equivalent on roughly a 3 month fuse, assumi…
