WelchLabsVideo

Visual breakdowns of AI research mechanisms, focused on papers and model internals, with an unusual angle.

Deep reads here1 / 15 episodes

Cadence~1 every 3.7 days

Latest2026-09-01

TopicsAI & Tech

PriorityT3

WelchLabsVideo 0901

Residual Connections: The Most Underrated Simple Hack in Deep Learning History

ResNet is the most cited paper of the 21st century, but its real contribution isn't deepening networks—it's the invention of the residual stream, a working memory that lets models store and edit information, fundamentally changing our understanding of neural networks.

6 Points 6 Quotes Residual NetworksDeep Learning