OurWord.
3 reads 中文

The world is too loud. Read what matters.

Interconnects

Nathan Lambert on post-training and open models; rigorous technical judgment

Deep reads here3 / 159 episodes
Cadence~1 every 5.9 days
Latest2026-08-12
TopicsAI & Tech
PriorityT1
12:32
Interconnects 0812

AI writing has stalled: long-form nonfiction is the real test of model ability

Models are improving only slowly at long-form nonfiction, which exposes a defect in how they organize knowledge — a more worrying signal than their progress in code and math, because it bears on whether AI can solve open scientific problems.

9 Points 7 Quotes AI writingnonfiction
49:05
Interconnects 0722

Open models aren't closing the gap by distilling — nobody knows how to distill usefully

Nathan Lambert takes apart, point by point, the narrative that Chinese open models are just distilled: using Fable/GPT 5.6 as a judge inside the RL stage does not pencil out on cost, and even if you were handed the strongest model's reasoning traces for free, the research community still does not know how to convert them into capability.

8 Points 5 Quotes Open modelsDistillation
20:03
Interconnects 0720

Open weights now trail closed models by 3-5 months, and that lag is the whole safety margin

Kimi K3 compresses the open-versus-closed gap from the 6-9 months people had been arguing over down to 3-5 months, and that lag is the only risk buffer anyone has — heavy-handed regulation of open weights would merely postpone the inevitable while voiding the buffer itself.

8 Points 5 Quotes Open weightsUS-China competition