Zuckerberg's Double Standard: Teen Safety Needs Regulation, AI Safety Needs the Market
Meta argues for uniform government regulation on teen safety, but insists the market will sort out AI safety — the same prisoner's dilemma, and he's standing on both sides.
The video won't play here. Listen to the audio instead:
The argument · tap a timestamp to hear it
Glasses are not phones, don't conflate them
Nilay rejects the tech industry's habit of lumping Meta Glasses and phones into one category. To film someone with a phone, you have to pull it out, open the camera, raise it to their face — that physical act is itself a declaration of intent, and other people can react to it. With glasses on, you press once and you're recording; there is no such declaration. He thinks the industry is rushing to stuff passive surveillance devices into the mental frame of "smartphone" to dodge a messier question: whether this class of device needs an entirely new social etiquette. And the social rules around phone recording weren't natural either — society argued about them for years and still hasn't finished.
— Nilay PatelYou demoted it yourself, so what's the pitch?
Nilay points to a fact Meta itself admits: Meta Glasses have been used to harass retail workers and women, and Meta has already demoted that kind of video on Instagram to reduce the incentive to make it. His follow-up is blunt — if you know content made with these glasses is bad enough that you have to demote it on your own platform, what exactly is good about the glasses, and worth fighting these fights over again and again? He also notes Zuckerberg says "we communicated clearly from the start," but the real question is: clear about what? The user's privacy, or the privacy of the person being filmed?
— Nilay PatelUsers define the product, not the company
Nilay offers a judgment he calls "the underlying truth of all mainstream consumer tech": users define the product. You sell a few million devices, people will use them in ways you never imagined, and those emergent behaviors often define the next generation of products. He cites Twitter — hashtags and @replies weren't invented by Twitter; users invented them first and Twitter adopted them later. So no matter how Meta explains what that light means, it can't stop people from using the glasses however they want. The real question is how much control Meta has over the bad actors harassing people with the glasses, and whether other platforms will follow its lead and demote the content.
— Nilay PatelHigh usage doesn't mean no harm
Zuckerberg says "people use it so much, that means they like the product," and Nilay cuts him off. He points out that the core allegation in the social media lawsuits is addiction, and that people compare social media to Big Tobacco precisely because smoking feels great, everyone enjoys it, and it kills you at the same time — usage rates and whether harm is being caused are two entirely different things. So from the very first sentence he wanted to press: can usage rate alone really measure whether something is good or bad for the world, or for an individual user?
— Nilay PatelPunished for transparency — that's what regulation is for
Nilay concedes Meta has genuinely done leading work on teen safety, and concedes a real unfairness: Meta publishes safety numbers, publishes research, files transparency reports, and gets penalized for disclosing the bad things happening on its platform; while a company like Apple, which has no idea what's happening on encrypted iCloud and publishes no numbers, gets off scot-free. But he argues this negative feedback loop is exactly what government regulation should solve — if all social platforms were required to disclose teen safety metrics, Meta would be compared against its peers instead of punished for the mere existence of the information. That idea did not appear in the settlement agreement.
— Nilay PatelTeen safety needs rules, AI safety doesn't
Zuckerberg describes teen safety as a prisoner's dilemma: if Meta unilaterally limits teens to one hour a day, users go to TikTok, nobody is any safer, and Meta only hurts itself. Nilay says this is telling — Zuckerberg doesn't believe a "safety market" exists; he thinks government has to force everyone to disarm together. But on AI safety, he stands on the other side of the prisoner's dilemma: in posts on Threads and X he says the market will solve it, that trust and alignment will become the most important capabilities distinguishing agents from models, that labs which neglect alignment will fall behind, and that model-caused harm will carry major liability. Nilay's question is simply: why does teen safety require government action, while AI safety is fine to go it alone?
— Nilay PatelA trillion dollars of liability isn't enough
Nilay cites Casey Newton's observation: in the recent teen safety case, Meta's own estimate of its potential damages liability was one trillion dollars, and that sum still appears insufficient to make Meta unilaterally act to prevent teens from being harmed. His follow-up: if a trillion dollars of potential liability isn't enough, how much would be enough to make Meta take AI safety seriously? Is there any liability number that would make everyone stop at the same time?
— Nilay PatelMuse wants to be the next Apple tax
Zuckerberg says Muse's business model is "taking a very small cut of transactions," possibly not even from the side that pays. Nilay says this is aggregation theory: Meta holds all consumer demand, so large that merchants will pay a small fee to reach those customers. But the problem is that merchants downstream of an aggregator hate the aggregator — and Zuckerberg knows this better than anyone, because Meta itself sits downstream of Apple's App Store: to reach iPhone users you have to go through the App Store, accept a pile of privacy rules, and pay 30% on most transactions. Apple's App Tracking Transparency nearly killed Meta's ad business, and boosting an Instagram post on mobile still means giving Apple 30%. So Nilay's question is: how do you make downstream merchants feel good about this arrangement, when you yourself felt so bad about it back then?
— Nilay PatelIn their own words · checked verbatim
if you want to record someone with your phone, you have to take it out of your pocket, open the camera app, and literally hold it in their face. This is a physical action that is meaningfully different than having a pair of glasses on your face with a light and just passively recording someone.
Nilay Patel3:05
if you know some of the content that is being made with these glasses is so bad that you've downranked it on your own distribution platform, what is so good about these glasses that make it worth having these debates over and over again?
Nilay Patel5:09
The users define the product. If you sell millions of gadgets to people, they will use them in ways you never expected.
Nilay Patel6:10
The reason people keep comparing social media to big tobacco is that smoking is fun, and people enjoyed it, and it was killing them. And so the usage rates had nothing to do with the harm that might have been occurring.
Nilay Patel11:19
It is very telling to me that Mark doesn't think there's a market for safety. That instead he thinks that everyone must be forced to unilaterally disarm by the government in a regulatory framework that solves his prisoner's dilemma.
Nilay Patel14:24
Meta estimated its own liability at a trillion dollars in damages, which does not appear to be enough liability for Meta to take unilateral action to prevent teens from being harmed on its platforms?
Nilay Patel16:27
How will you make it so all of the businesses downstream of your huge aggregator AI agent feel good about this arrangement? Because when you've been in this arrangement, you have felt very, very bad.
Nilay Patel21:45
Figures
| Meta's own estimate of damages liability in the teen safety case | one trillion dollars | 16:27 |
| Apple App Store's cut on most transactions on iPhone | 30% | 21:45 |
| Muse free tier | 100 million tokens per week | 25:05 |
Glossary
- aggregation theory
- Whoever controls consumer demand can charge the merchants who want to reach those consumers.
- App Tracking Transparency
- Apple's privacy rule change requiring apps to get user permission to track across apps, which badly damaged Meta's ad business.
- prisoner's dilemma
- A situation where acting alone never pays off, and only being forced to act together produces a better collective outcome.
How to listen
Founders, investors and policy watchers focused on platform regulation, AI safety policy and Meta's strategy — especially anyone trying to understand the inconsistency in Zuckerberg's regulatory stance.
The two ad segments at the top and the sponsor break in the middle can be skipped.