AI 安全語言正在毀掉監管討論：那是 bug，不是惡魔

核心論點 · 點時間戳可跳到原聲

原話 · 已逐字校驗

The AI people are making it impossible for anybody to understand what they've done. And they're using words like, well, the AI failed to be aligned. Okay, what does that mean? What it means is there was a bug in the software.

AI 圈的人正在讓任何人都不可能理解他們做了什麼。他們用的說法是「AI 沒能對齊」。好吧，那是什麼意思？意思是軟件裡有個 bug。

Steven Sinofsky0:00

When Word ate your file and deleted all your content, we didn't think that demons had taken over Word and made it do things against the will of man.

當年 Word 吃掉你的文件、刪光你所有內容時，我們沒覺得是有惡魔附身 Word，讓它違揹人的意志行事。

Steven Sinofsky5:06

if full self-driving blows through a stop sign because the software interpreted the stop sign as like a Christmas tree, we don't sit around and say, oh, it was not aligned with the idea of, you know, December holiday seasons and road signs. We actually say it's a bug and it's a very dangerous bug because that stop sign means something.

如果全自動駕駛闖過一個停車標誌，是因為軟件把停車標誌理解成了聖誕樹，我們不會坐在那兒說「哦，它沒有對齊十二月假期和路標的理念」。我們會說這是個 bug，而且是個非常危險的 bug，因為那個停車標誌是有含義的。

Steven Sinofsky7:07

Nobody had imagined you could create a bug that in 12 hours could do $12 billion worth of damage. But we did it.

沒人想像過你能造出一個 bug，在 12 小時內造成 120 億美元的損失。但我們做到了。

Steven Sinofsky14:10

It is pure insanity to just sit and argue that higher powers need to be summoned in order to fix this.

坐在那裡爭論說需要召喚更高力量來解決這件事，純屬瘋狂。

Steven Sinofsky16:10

There was a lot of worry by professionals. And then there was a lot of taking of responsibility by professionals. And then nothing bad happened. There's a direct causal relationship.

專業人士大量擔憂，然後專業人士大量承擔責任，然後什麼都沒發生。這裡有直接的因果關係。

Steven Sinofsky17:10

when a normal person like a congressman hears goal seeking, they think of a person trying to get an A in college. And then when they hear cheating, they hear that they did the thing you're not allowed to do. And when they hear secretly coordinating, they think of spies invading a country.

當一個普通人、比如一個國會議員聽到 goal seeking，他想到的是一個人想在大學裡拿 A。聽到 cheating，他聽到的是做了不被允許做的事。聽到 secretly coordinating，他想到的是間諜入侵一個國家。

Steven Sinofsky21:13

when they predict a hurricane path and then the hurricane goes through in a different way, the weather people all get together and look at the model and talk about the bugs in the model that led to the incorrect forecast. They don't appeal to Zeus and say, please, Zeus, tell us why our weather was wrong.

當他們預測颶風路徑、而颶風走了另一條路時，氣象人員會聚在一起看模型，討論導致錯誤預報的模型 bug。他們不會去求宙斯說：宙斯啊，請告訴我們為什麼我們的天氣錯了。

Steven Sinofsky26:23

數字與實體

術語

alignment對齊

讓 AI 行為符合人類意圖的說法；Sinofsky 認為它把軟件 bug 包裝成了道德問題。

telemetry遙測

軟件崩潰或異常時自動回傳運行數據的機制，是定位 bug 的前提。

CVE通用漏洞披露

公開記錄軟件安全漏洞的編號體系，Sinofsky 視其為缺陷上報的範本。

OPSEC運營安全

operational security，指通過流程和配置防止系統被入侵或濫用的實踐。

SevOne, PriOne一級嚴重度、一級優先級

微軟內部對 bug 的行話：severity 一是丟數據，priority 一是必須修。

收聽指南