Subscribe
Sign in
Home
Podcast
Navigation
($) Discord
Archive
About
Articles
Latest
Top
Discussions
RL backlog: OpenAI's many RLs, clarifying distillation, and latent reasoning
Notes I forgot to publish. Closing some loose ends in the reasoning model discussions.
Apr 5
•
Nathan Lambert
52
Deep Research, information vs. insight, and the nature of science
What AI will accelerate in the scientific process, what it cannot do, and how we can prepare for new manners of scientific investigation.
Feb 12
•
Nathan Lambert
118
26
Making the U.S. the home for open-source AI
Open-source AI is here to stay, but it is not a given that it will be American.
Feb 5
•
Nathan Lambert
58
19
Why reasoning models will generalize
People underestimate the long-term potential of “reasoning.”
Jan 28
•
Nathan Lambert
206
7
DeepSeek R1's recipe to replicate o1 and the future of reasoning LMs
Yes, ring the true o1 replication bells for DeepSeek R1 🔔🔔🔔. Where we go next.
Jan 21
•
Nathan Lambert
233
2
Let me use my local LMs on Meta Ray-Bans
Different futures for AI devices and how we can start creating positive feedback loops for some types of open-weight language models.
Jan 15
•
Nathan Lambert
20
2
DeepSeek V3 and the actual cost of training frontier AI models
The $5M figure for the last training run should not be your basis for how much frontier AI models cost.
Jan 9
•
Nathan Lambert
127
8
2024 Interconnects year in review
Two years writing every week on AI.
Dec 31, 2024
•
Nathan Lambert
29
2
OpenAI's o3: The grand finale of AI in 2024
A step change as influential as the release of GPT-4. Reasoning language models are the current big thing.
Dec 20, 2024
•
Nathan Lambert
106
4
The AI agent spectrum
Separating different classes of AI agents from a long history of reinforcement learning.
Dec 18, 2024
•
Nathan Lambert
62
OpenAI's Reinforcement Finetuning and RL for the masses
The cherry on Yann LeCun’s cake has finally been realized.
Dec 11, 2024
•
Nathan Lambert
80
OpenAI's o1 using "search" was a PSYOP
How to understand OpenAI's o1 models as really just one wacky, wonderful, long chain of thought
Dec 4, 2024
•
Nathan Lambert
61
2
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts
