Subscribe
Sign in
Home
Podcast
Navigation
Archive
About
Latest
Top
Discussions
The Q* hypothesis: Tree-of-thoughts reasoning, process reward models, and supercharging synthetic data
Emergency special: The information we need to understand what Q* is was right in front of us, but the memes are more fun than reality.
Nov 24, 2023
•
Nathan Lambert
99
Share this post
Interconnects
The Q* hypothesis: Tree-of-thoughts reasoning, process reward models, and supercharging synthetic data
Copy link
Facebook
Email
Notes
More
5
Behind the curtain: what it feels like to work in AI right now (April 2023)
Fear, FOMO, and the scientific exodus driven by ChatGPT
Apr 5, 2023
•
Nathan Lambert
96
Share this post
Interconnects
Behind the curtain: what it feels like to work in AI right now (April 2023)
Copy link
Facebook
Email
Notes
More
21
Reverse engineering OpenAI’s o1
What productionizing test-time compute shows us about the future of AI. Exploration has landed in language model training.
Sep 16, 2024
•
Nathan Lambert
130
Share this post
Interconnects
Reverse engineering OpenAI’s o1
Copy link
Facebook
Email
Notes
More
2
Llama 2: an incredible open LLM
Meta is continuing to deliver high-quality research artifacts and not backing down from pressure against open source.
Jul 18, 2023
•
Nathan Lambert
60
Share this post
Interconnects
Llama 2: an incredible open LLM
Copy link
Facebook
Email
Notes
More
7
The AI research job market shit show (and my experience)
There are plenty of jobs, but finding a place where you're happy is as hard as ever.
Oct 11, 2023
•
Nathan Lambert
79
Share this post
Interconnects
The AI research job market shit show (and my experience)
Copy link
Facebook
Email
Notes
More
OpenAI's o3: The grand finale of AI in 2024
A step change as influential as the release of GPT-4. Reasoning language models are the current big thing.
Dec 20, 2024
•
Nathan Lambert
104
Share this post
Interconnects
OpenAI's o3: The grand finale of AI in 2024
Copy link
Facebook
Email
Notes
More
4
How RLHF actually works
Why RLHF may still win out and why we haven't seen it yet in open-source.
Jun 21, 2023
•
Nathan Lambert
53
Share this post
Interconnects
How RLHF actually works
Copy link
Facebook
Email
Notes
More
3
OpenAI's o1 using "search" was a PSYOP
How to understand OpenAI's o1 models as really just one wacky, wonderful, long chain of thought
Dec 4, 2024
•
Nathan Lambert
60
Share this post
Interconnects
OpenAI's o1 using "search" was a PSYOP
Copy link
Facebook
Email
Notes
More
2
OpenAI’s Strawberry, LM self-talk, inference scaling laws, and spending more on inference
OpenAI’s Strawberry, LM self-talk, inference scaling laws, and spending more on inference. Coming waves in LLMs.
Sep 5, 2024
•
Nathan Lambert
86
Share this post
Interconnects
OpenAI’s Strawberry, LM self-talk, inference scaling laws, and spending more on inference
Copy link
Facebook
Email
Notes
More
AI for the rest of us
Apple Intelligence makes a lot of sense when you get out of the AI bubble. Plus, the cool technical details Apple shared about their language models…
Jun 12, 2024
•
Nathan Lambert
31
Share this post
Interconnects
AI for the rest of us
Copy link
Facebook
Email
Notes
More
State-space LLMs: Do we need Attention?
Mamba, StripedHyena, Based, research overload, and the exciting future of many LLM architectures all at once.
Dec 20, 2023
•
Nathan Lambert
58
Share this post
Interconnects
State-space LLMs: Do we need Attention?
Copy link
Facebook
Email
Notes
More
4
The AI agent spectrum
Separating different classes of AI agents from a long history of reinforcement learning.
Dec 18, 2024
•
Nathan Lambert
57
Share this post
Interconnects
The AI agent spectrum
Copy link
Facebook
Email
Notes
More
Share
Copy link
Facebook
Email
Notes
More
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts