Jerk Day Feb 15 2024
Jerk (dʒɜːk): An increase in the rate of accleration
Here’s today at a glance:
🌎 Google Moves The World Forward
Jeff Dean announces Gemini Pro 1.5 in developer preview, in Google’s usual style, preventing many people from actually using the tech while declaring how great it actually is.
It does seem to be a breakthrough:
Looong Context - Up to 10 million tokens, with perfect recall in needle in the haystack tests
Multimodal - hours of video and audio
Reasoning about code, audio, and video
Working with large codebases
It’s a large mixture of experts
Maybe in 6 months when Google finally allows open access, we’ll finally be able to figure out whether it’s better than GPT-4. But if they actually solved the large codebase problem without burning too many GPUs at inference, we may be on the precipice of the next great leap forward.
📹 OpenAI Releases Spectacular Video Model
Up to a minute of video generation from a text prompt.
Character consistent
Physics
Reflections
This is going to accelerate everything. Creating an entire world in 3D engines like Unreal, with what used to take $100 million dollars coming down to $100 dollars. Create movies and ads. It’s 3 years of progress in a day.
The implications are enormous. Simply mind-boggling. And just getting started.
I don’t have much to say. Just drool over the videos, por favor.
Dimestore Steven Spielberg. Still has that 3D render quality
A bit generic on the animals, but otherwise, very good
Who needs to actually travel anymore? Straight line from here to an Apple Vision Pro panorama in a couple of years
Superheroes are so over
So are Grandmas
Pixar cartoons
🗞️ Things Happen and Happen and Happen
There’s just simply not enough words or time to capture what happened on Thursday, February 15, 2024. The above must do for now. The open source catchup trajectory is very steep for now.
I do wish the big firms would at least release their benchmarks and evaluations. There isn’t enough data right now on what to target.
Oh well.




