Satya Nadella: AGI Is Nonsensical Benchmark Hacking. Here's What Actually Matters.
- Length
- 6 min
- Language
- English
- Text from
- the video's captions
- Transcribed
- 14 October 2026
Summary
Satya Nadella discusses how AI agents are being used inside Microsoft, including a multi-agent orchestrator built by a networking engineer to automate fiber DevOps. He explains his vision for proactive agents tied to user intent with transparency, and defends his comment that AGI is benchmark hacking, arguing the real measure of AI is economic impact in areas like health care and education.
Key points
- A Microsoft networking engineer built a multi-agent orchestrator with low code/no code and Foundry tools to automate manual fiber DevOps.
- Nadella compares AI tool empowerment to Excel as the world's most ubiquitous programming tool.
- An on-device proactive agent demo on Copilot Plus PCs summarized email in Outlook without internet.
- He cites Mark Weiser's vision that technology should be powerful enough to disappear, and agents should act on high-level intent while staying inspectable.
- Nadella says his AGI comment was not a shadow on AI research but a critique of celebrating tech companies over technology's real impact.
- Health care is 19-20% of US GDP, and he wants the multi-agent health care orchestrator used by Stanford to become ubiquitous.
- A World Bank study in Nigeria gives statistical evidence that giving students Copilot changes educational outcomes.
Questions it answers
00:00Agent built for fiber DevOps
How are AI agents being used inside Microsoft?
A networking engineer dealing with manual fiber DevOps built a multi-agent orchestrator using low code/no code and Foundry tools to automate the workflow. Nadella says empowering people closest to their workflows with tools and agency is what needs to happen.
- A Microsoft engineer built a multi-agent orchestrator using low code/no code and Foundry tools.
- Nadella compares this empowerment to how everyone learned programming through Excel.
01:23Proactive agents and user control
What is Nadella's vision for proactive agents?
He references Mark Weiser's quote about ubiquitous computing, where technology is powerful enough to disappear. Agents should interpret intent, plan, and get things done with minimal friction, but the user must stay in control and be able to inspect what agents do, like watching a coding agent's session log with draft commits.
- Nadella cites Mark Weiser's idea that powerful technology should disappear.
- He wants agents chained to high-level intent with inspectable session logs.
02:55AGI as benchmark hacking
Why did Nadella call AGI nonsensical benchmark hacking?
He says his comment was not a shadow on AI research, but that society celebrates tech companies too much versus the impact of technology. The true value of AI is real-world economic gains, such as reducing health care workflow inefficiency, since health care is 19-20% of US GDP.
- Health care is 19-20% of US GDP with much cost tied to workflow inefficiency.
- He wants the multi-agent orchestrator for health care used by Stanford to become ubiquitous.
04:55Impact in education
What example of real AI impact does Nadella point to in education?
He points to a World Bank study in Nigeria showing statistical evidence that giving people Copilot or similar agents changes outcomes in education. He says that story is why he joined the tech industry, and he dislikes the industry celebrating itself instead of technology's impact.
- A World Bank study in Nigeria showed measurable change from giving people Copilot.
- Nadella says this real impact is why he joined the tech industry.
Notes
Agents inside Microsoft
- A Microsoft networking engineer faced manual DevOps for the AI fiber network, handled via emails and calls for fiber cuts.
- She built an agent, in fact a multi-agent orchestrator, using low code/no code and the Foundry tools.
- Nadella compares this to Excel as the greatest, most ubiquitous programming tool: empowering people with tools and agency over the workflow closest to them is what needs to happen.
Proactive agents and control
- A demo showed an on-device proactive agent on Copilot Plus PCs opening Outlook and summarizing email without internet.
- Nadella cites Mark Weiser's quote on ubiquitous computing: technology is powerful enough to disappear.
- The goal is to interpret intent, plan, and get things done with the least friction.
- Computer use agents must become fast, better, and more reliable, but more importantly be chained to a high-level intent of the user, who can inspect the work.
- He praises the coding agent's session log with draft commits as the right balance of proactivity and transparency across multiple invoked agents.
AGI as benchmark hacking
- Asked about his viral comment that AGI is nonsensical benchmark hacking, Nadella says it was not a shadow on great AI research.
- He argues society celebrates tech companies far too much versus the impact of technology.
Real value: health care and education
- Health care is 19-20% of US GDP, and much of its cost is workflow inefficiency that providers cannot tame despite digital systems.
- He would love to see the multi-agent orchestrator for health care, just launched and used by Stanford, become ubiquitous so providers deliver better care at lower cost.
- In education, a World Bank study in Nigeria provides real statistical evidence that giving people Copilot or any other agent changes outcomes.
- Nadella says that kind of impact is why he joined the tech industry, and he dislikes the industry celebrating itself.
Text from the video's own captions. Summary and notes written by AI from the transcript, so check anything important against the recording.