Articles

RL backlog: OpenAI's many RLs, clarifying distillation, and latent reasoning

Notes I forgot to publish. Closing some loose ends in the reasoning model discussions.

Apr 5 •

Deep Research, information vs. insight, and the nature of science

What AI will accelerate in the scientific process, what it cannot do, and how we can prepare for new manners of scientific investigation.

Feb 12 •

Making the U.S. the home for open-source AI

Open-source AI is here to stay, but it is not a given that it will be American.

Feb 5 •

Why reasoning models will generalize

People underestimate the long-term potential of “reasoning.”

Jan 28 •

DeepSeek R1's recipe to replicate o1 and the future of reasoning LMs

Yes, ring the true o1 replication bells for DeepSeek R1 🔔🔔🔔. Where we go next.

Jan 21 •

Let me use my local LMs on Meta Ray-Bans

Different futures for AI devices and how we can start creating positive feedback loops for some types of open-weight language models.

Jan 15 •

DeepSeek V3 and the actual cost of training frontier AI models

The $5M figure for the last training run should not be your basis for how much frontier AI models cost.

Jan 9 •

2024 Interconnects year in review

Two years writing every week on AI.

Dec 31, 2024 •

OpenAI's o3: The grand finale of AI in 2024

A step change as influential as the release of GPT-4. Reasoning language models are the current big thing.

Dec 20, 2024 •

The AI agent spectrum

Separating different classes of AI agents from a long history of reinforcement learning.

Dec 18, 2024 •

OpenAI's Reinforcement Finetuning and RL for the masses

The cherry on Yann LeCun’s cake has finally been realized.

Dec 11, 2024 •

OpenAI's o1 using "search" was a PSYOP

How to understand OpenAI's o1 models as really just one wacky, wonderful, long chain of thought

Dec 4, 2024 •

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts