Subscribe
Sign in
Home
Audio
Archive
Leaderboard
About
New
Top
Discussion
Synthetic data: Anthropic’s CAI, from fine-tuning to pretraining, OpenAI’s Superalignment, tips, types, and open examples
Synthetic data is the accelerator of the next phase of AI — what it is and what it means.
Nov 29
•
Nathan Lambert
36
Share this post
Synthetic data: Anthropic’s CAI, from fine-tuning to pretraining, OpenAI’s Superalignment, tips, types, and open examples
www.interconnects.ai
Copy link
Facebook
Email
Note
Other
1
The Q* hypothesis: Tree-of-thoughts reasoning, process reward models, and supercharging synthetic data
Emergency special: The information we need to understand what Q* is was right in front of us, but the memes are more fun than reality.
Nov 24
•
Nathan Lambert
73
Share this post
The Q* hypothesis: Tree-of-thoughts reasoning, process reward models, and supercharging synthetic data
www.interconnects.ai
Copy link
Facebook
Email
Note
Other
5
RLHF progress: Scaling DPO to 70B, DPO vs PPO update, Tülu 2, Zephyr-β, meaningful evaluation, data contamination
Huge steps forward in confirming that RLHF can really help you on vibes based evaluation, among many other RLHF analyses.
Nov 22
•
Nathan Lambert
20
Share this post
RLHF progress: Scaling DPO to 70B, DPO vs PPO update, Tülu 2, Zephyr-β, meaningful evaluation, data contamination
www.interconnects.ai
Copy link
Facebook
Email
Note
Other
1
OpenAI’s shakeup and opportunity for the rest of us: openness, brain drain, and new realities
New timelines that emerge in AI and the winners and losers, regardless of the unfolding details.
Nov 19
•
Nathan Lambert
14
Share this post
OpenAI’s shakeup and opportunity for the rest of us: openness, brain drain, and new realities
www.interconnects.ai
Copy link
Facebook
Email
Note
Other
2
The interface era of AI
Modern LLMs are becoming the easiest and most efficient way to access information. This will change how we see the world.
Nov 15
•
Nathan Lambert
11
Share this post
The interface era of AI
www.interconnects.ai
Copy link
Facebook
Email
Note
Other
1
Reckoning with the Shoggoth of AI
Culture wars, open letters, new politics, developer days, and everything hidden under the smiling face of RLHF.
Nov 8
•
Nathan Lambert
8
Share this post
Reckoning with the Shoggoth of AI
www.interconnects.ai
Copy link
Facebook
Email
Note
Other
Open LLM company playbook
Where does releasing model weights fit into company strategy? 3 requirements, 3 actions, and 3 benefits of being in the open LLM space.
Nov 1
•
Nathan Lambert
16
Share this post
Open LLM company playbook
www.interconnects.ai
Copy link
Facebook
Email
Note
Other
2
October 2023
How the Foundation Model Transparency Index Distorts Transparency
A proper critique of the Foundation Model Transparency Index (FMTI). Plus some thoughts on the ecosystem implications.
Oct 26
•
Nathan Lambert
8
Share this post
How the Foundation Model Transparency Index Distorts Transparency
www.interconnects.ai
Copy link
Facebook
Email
Note
Other
2
RLHF lit. review #1 and missing pieces in RLHF
Looking at the difference between two sets -- what rumors say industry leaders are doing with RLHF and what the literature is up to. I'm starting my new…
Oct 25
•
Nathan Lambert
12
Share this post
RLHF lit. review #1 and missing pieces in RLHF
www.interconnects.ai
Copy link
Facebook
Email
Note
Other
1
Undoing RLHF and the brittleness of safe LLMs
Most of the arguments about "safe" releases of open LLM weights are nearly dead in the water.
Oct 18
•
Nathan Lambert
16
Share this post
Undoing RLHF and the brittleness of safe LLMs
www.interconnects.ai
Copy link
Facebook
Email
Note
Other
The AI research job market shit show (and my experience)
There are plenty of jobs, but finding a place where you're happy is as hard as ever.
Oct 11
•
Nathan Lambert
67
Share this post
The AI research job market shit show (and my experience)
www.interconnects.ai
Copy link
Facebook
Email
Note
Other
LLMs are computing platforms
This fact is why so many debates around LLMs feel broken, especially moderation.
Oct 6
•
Nathan Lambert
10
Share this post
LLMs are computing platforms
www.interconnects.ai
Copy link
Facebook
Email
Note
Other
6
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts