Archive - Interconnects

State of play of AI progress (and related brakes on an intelligence explosion)

Why I don't think AI 2027 is going to come true.

20 hrs ago •

Qwen 3: The new open standard

A wonderful release, base models, reasoners, model size scales, and all before LlamaCon.

Apr 28 •

Transparency and (shifting) priority stacks

What you want to be open says a lot about your ranked priorities.

Apr 28 •

The latest open artifacts (#9): RLHF book draft, where the open reasoning race is going, and unsung heroes of open LM work

Artifacts Log 9.

Apr 21 •

and

OpenAI's o3: Over-optimization is back and weirder than ever

Tools, true rewards, and a new direction for language models.

Apr 19 •

OpenAI's GPT-4.1 and separating the API from ChatGPT

OpenAI's latest models optimizing on intelligence per dollar. We'll continue to see ChatGPT handled differently than the API business.

Apr 14 •

Llama 4: Did Meta just push the panic button?

One of the weirdest releases of the year and understanding the future of the Llama endeavor. For the time being, we have some more amazing open weight…

Apr 7 •

RL backlog: OpenAI's many RLs, clarifying distillation, and latent reasoning

Notes I forgot to publish. Closing some loose ends in the reasoning model discussions.

Apr 5 •

March 2025

Recent reasoning research: GRPO tweaks, base model RL, and data curation

The papers I endorse as worth reading among a cresting wave of reasoning research.

Mar 31 •

GPT-4o's images and lessons from native input-output multimodality

Hints of a natively multi-modal future.

Mar 30 •

Gemini 2.5 Pro and Google's second chance with AI

The end of a busy spring of model improvements and what's next for the presumed leader in AI abilities.

Mar 26 •

The latest open artifacts (#8): The return of ~30B models, side effects of OpenAI's proposed DeepSeek ban, and yet another reasoning roundup

Artifacts Log 8. Expect this pace to continue until mid summer.

Mar 20 •

and

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts