Interconnects
Interconnects
(Voiceover) Tülu 3: The next era in open post-training
1×
0:00
Current time: 0:00 / Total time: -7:58
-7:58

(Voiceover) Tülu 3: The next era in open post-training

We give you open-source, frontier-model post-training.
Nathan Lambert
Nov 21, 2024
Share
Transcript

Original post:

Tülu 3: The next era in open post-training

Nathan Lambert
·
Nov 21
Tülu 3: The next era in open post-training

Post-training, the craft of eliciting powerful behaviors from a raw pretrained language model, has gone through many seasons and moods since the release of ChatGPT. In the era of Alpaca, Vicuna, Koala, and Dolly, a limited number of human datapoints with extended synthetic data in the style of

Read full story

Chapters

00:00 History

05:44 Technical details sneak peak

Figures

Fig 1, results: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/tulu3-img/results.webp

Fig 2, overview: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/tulu3-img/overview.webp

Fig 3, preferences: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/tulu3-img/preferences.webp

Fig 4, RLVR: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/tulu3-img/rlvr.webp

Discussion about this podcast

Interconnects
Interconnects
Audio essays about the latest developments in AI and interviews with leading scientists in the field. Breaking the hype, understanding what's under the hood, and telling stories.
Listen on
Substack App
Apple Podcasts
Spotify
YouTube
Overcast
Pocket Casts
RSS Feed
Appears in episode
Nathan Lambert
Recent Episodes
(Voiceover) OLMo 2 and building effective teams for training language models
 • Nathan Lambert
(Voiceover) Scaling realities
 • Nathan Lambert
(Voiceover) Saving the National AI Research Resource & my AI policy outlook
 • Nathan Lambert
Interviewing Tim Dettmers on open-source AI: Agents, scaling, quantization and what's next
 • Nathan Lambert
Interviewing Andrew Carr of Cartwheel on the State of Generative AI
 • Nathan Lambert
(Voiceover) Why I build open language models
 • Nathan Lambert
(Voiceover) Claude's agentic future and the current state of the frontier models
 • Nathan Lambert