scaling

How to scale RL

The most covetable research.

Oct 20 • Nathan Lambert

GPT-4.5: "Not a frontier model"?

OpenAI's latest model raises more questions than answers, but no, the AI bubble isn't popping quite yet.

Feb 28 • Nathan Lambert

Scaling realities

Both stories are true. Scaling still works. OpenAI et al. still have oversold their promises.

Nov 14, 2024 • Nathan Lambert

How scaling changes model behavior

Some trends are reasonable to extrapolate, some are not. Even for the trends we are succeeding at extrapolating, it is not clear how that signal…

Oct 9, 2024 • Nathan Lambert

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts