Satya Nadella says AI-found bugs will make outages more likely

At DealBook, Satya Nadella said failed AI alignment would leave the world in trouble, and that models with unreadable reasoning should be banned. Microsoft, he added, can trail the frontier on far less compute.


Satya Nadella says AI-found bugs will make outages more likely

Satya Nadella speaks at the World Economic Forum Annual Meeting in Davos, 20 January 2026

Image Credits Credit: World Economic Forum / CC BY-NC-SA 4.0 via Flickr (cropped)

Satya Nadella expects more outages like the one that took down Outlook last week, because AI now finds software flaws faster than companies can safely fix them. The Microsoft chief executive spoke to Andrew Ross Sorkin at The New York Times’ DealBook Summit in New York on Wednesday.

He apologised for Microsoft’s own outage, which he said had no direct link to that problem.

“This was a latent bug that was there. It got invoked and, you know, it’s one of those perfect storms,” Nadella said.

Later that day, he told Jim Cramer on CNBC’s Mad Money that Microsoft could have done more to prevent it.

“Of course, we should have done the testing before. We should have figured out how to have the bulkheads such that you didn’t have a global outage,” Nadella told Cramer.

Patches with no time to test

The bigger risk comes from AI tools that find vulnerabilities, Nadella said. A fix for a critical bank system used to get a week of testing. Now attackers exploit flaws as soon as they surface, so fixes go straight into production. On the day he spoke, he said, three critical patches had landed for open-source packages.

“The patch needs to go instantly from being available to being patched in production, because it’s being exploited in the wild. So that’s going to create its instability,” he said.

Banks and the NSA have reportedly blamed this week’s US outages on rushed patches for AI-found flaws. Nadella also said the “floor of cyberattacks has fallen”. With AI models, anyone can now run what amounts to a persistent, nation-state-level attacker, he said.

Sorkin asked whether this was a passing phase. Nadella compared it to the Y2K bug, but said he had no view yet, because models keep getting more capable. Much critical infrastructure runs firmware that nobody can patch, he added. He named chillers, heating and cooling systems, and transport networks that sit on the internet.

‘A world of hurt’

Last month, Nadella told 20VC that alignment would not come from scale alone. Sorkin said Sam Altman, who spoke earlier at the summit, disagreed with that premise.

Nadella said he learned about scaling laws from OpenAI’s founders, and that scaling had worked. Alignment, and a real way to debug models, had not followed, he said. He hoped Altman and Greg Brockman were right.

“I mean, if it doesn’t happen, we are in a world of hurt,” Nadella said.

His answer is what he called a trust architecture. He would ban models that reason in neuralese, an internal shorthand people cannot read. Every model’s reasoning needs tamper-proof logs that other models can inspect, he said, because models will try to hide what they are doing. He praised OpenAI for monitoring its models during training runs.

For now, whoever deploys an AI system is liable for what it does, Nadella said. He expects insurers to price that risk and to ask for the logs.

Cheap tokens, borrowed frontier

Sorkin asked what happens to OpenAI and Anthropic, in which Microsoft holds stakes, if cheaper models can do the same work. Nadella said everyday office work no longer needs frontier models. Copilot already chooses between OpenAI, Anthropic, and Microsoft’s own MAI models, he said. He added that his bigger stake is in Microsoft.

“Arguing for some massive pricing power of tokens is betting against somehow US GDP,” he said.

Microsoft’s deal with OpenAI gives it royalty-free access to a frontier model until 2032, Nadella said. That lets Microsoft build MAI models three to six months behind the frontier, using 5% to 20% of the computing power. Anthropic and OpenAI play “a vertical stack game”, he said, while Microsoft plays “a model system game”.

Agents, jobs, and Washington

AI agents will reshuffle who pays whom on the web, as the move from Yahoo to search once did, Nadella said. Sites that live off ads from human visitors will have to change. Asked about sites that keep agents out, such as Amazon, he said rivals would take the business.

“If you don’t accept the agent, somebody else will. If Amazon doesn’t, Shopify will,” Nadella said.

The staff buyouts Microsoft offered 60,000 people were meant to give everyone agency, he said. Software engineering is “very much alive”, but the work has changed. The team behind Microsoft’s Cowork agent is 11 developers who build “a software factory that builds the product”. That shift will take longer than anyone expects, Nadella said.

Sorkin noted that Nadella has kept his distance from the Trump administration. Nadella said his job is to earn Microsoft’s permission to operate through its products.

“I just don’t want to be in Washington. I just want to be in Redmond, Washington,” he said.

Get the TNW newsletter

Get the most important tech news in your inbox each week.

Thanks! Check your inbox to confirm your subscription.

By subscribing you agree to our Privacy Statement.

Published
Back to top