Machine Learning Street Talk
The most rigorous academic debate; often counter to the mainstream narrative
1:53:12Deep Learning Finally Beat XGBoost at Tabular Data - By Training on Synthetic Data
Real tabular datasets you can actually find number only about 50,000 - not enough to feed a deep network. So PriorLabs switched to mass-synthesizing training data from causal structural models, and TabPFN became the first model to consistently beat XGBoost and CatBoost on tabular prediction.
25:57A world model doesn't predict the future, it ranks robots for validation
Cosmos 3 stuffs forward dynamics, inverse dynamics and policy into one model, but the first thing it ships isn't training — it's using a neural simulator to rank a pile of checkpoints and filter most of them out before they ever touch real hardware.
1:42:22Speech Recognition Isn't Solved: Models Still Err Constantly in Customer Service
Customers building voice customer-service systems report that even the most common support scenarios are far from solved — models still make frequent errors, and shipping requires heavy engineering to paper over the gaps.
49:00Encrypted Reasoning Is Not a Secret: A Small Model Will Read the Big One's Thinking Out Loud
Frontier models hand the user an encrypted copy of their thinking along with the answer, but that ciphertext can be replayed verbatim into a smaller model from the same family, which will simply read it out — opening the door to privacy leaks, jailbreaks, prompt injection, and even a channel for distilling capability.