Interconnects

Home
Chat
Archive
About
New
Top
Discussion
Evaluating and uncovering open LLMs
When choosing a model, we're stuck in the middle between classic NLP benchmarks (e.g. MMLU) and qualitative chatbot ranking. Neither are exactly what we…
 • 
Nathan Lambert
2
Code: green pastures for LLMs
Both code-generation and code-training seem central to LLM progress, present and future.
 • 
Nathan Lambert
Unfortunately, OpenAI and Google have moats
While everyone went crazy over a leaked memo, no one took the time to think through how companies have worked in the internet era.
 • 
Nathan Lambert
3
Specifying hallucinations
The future of LLM errors and the need for a discourse around the specification of unexpected outputs.
 • 
Nathan Lambert
6
April 2023
Beyond human data: RLAIF needs a rebrand
Reinforcement learning from computational feedback: how a promising method is being ignored because of a confusing launch.
 • 
Nathan Lambert
3
The next chapter: Interconnects
Democratizing Automation is now Interconnects. Doubling down on making the most important links in AI.
 • 
Nathan Lambert
Growing needs for accessing state-of-the-art reward models
The rewards assigned by these models will control the subjective experience of users; the subjective experience controls their decision-making.
 • 
Nathan Lambert
8
Behind the curtain: what it feels like to work in AI right now
Fear, FOMO, and the scientific exodus driven by ChatGPT
 • 
Nathan Lambert
21
March 2023
The implicit dynamics of optimizing costs vs. rewards vs. preferences
With the emergence of reinforcement learning from human feedback, we've been applying old techniques with a new guiding function (🤫 RLHF).
 • 
Nathan Lambert
GPT4: The quiet parts and the state of ML
Checking in on the state of the ML field: technical progress, societal implications, and more.
 • 
Nathan Lambert
1
AGI Roundup: Re-visiting Go; transitioning from narrow to general; multimodality & GPT4
AI is much more fun to think about when AGI is an adjective, not a finish line.
 • 
Nathan Lambert
February 2023
The RLHF battle lines are drawn
Tales of the open and closed sides, how these two dynamics will dictate progress and public perception.
 • 
Nathan Lambert
© 2023 Nathan Lambert
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great writing