
Greg Brockman: OpenAI and AGI
- Length
- 1 h 25 min
- Language
- English
- Text from
- the video's captions
- Transcribed
- 13 October 2026
Summary
In this conversation, OpenAI co-founder and CTO Greg Brockman talks with Lex Fridman about the mission of OpenAI, the structure and rationale behind OpenAI LP, and the thinking behind the OpenAI charter. He discusses the GPT-2 release decision, the Dota self-play project, the role of scale and ideas in deep learning, and questions of safety, value alignment, policy, and consciousness. He argues that AGI could be the most transformative technology ever created and that the key lever is setting the right initial conditions for how it is developed and deployed.
Key points
- Brockman argues the only real degree of freedom a creator has is setting the initial conditions under which a technology is born, as with the internet and Wikipedia.
- OpenAI is structured around three arms: capabilities, safety, and policy, addressing technical progress, value alignment, and governance.
- OpenAI LP is a capped-profit company whose fiduciary duty is to the charter, with excess value legally titled to the nonprofit.
- Deep learning's generality, competence, and scalability make AGI feel achievable for the first time, though missing pieces like reasoning remain.
- OpenAI withheld the full GPT-2 model as a test case for developing responsible disclosure norms in AI.
- Distinguishing AI-generated content from human content online is ultimately a losing battle; the key line to draw is deception.
- The Dota bots were trained via self-play at massive scale and reached professional level, with an 80% win-rate bot existing two weeks after The International losses.
- Brockman thinks scaling GPT-2 alone is unlikely to produce full reasoning, and OpenAI is starting a new long-term reasoning team.
Questions it answers
01:08Digital vs physical worlds
Why does Brockman find the digital world more compelling than the physical one?
He says programming and mathematics both put truths into humanity's permanent library, but software offers insane leverage: a single individual with an idea can affect the entire planet. He also sees humans and society itself as information processing systems, and invokes Asimov's psychohistory and technological determinism to argue that individuals can't invent things no one else ever would.
- Brockman values the digital world for its massive scalability and leverage.
- He views humans and society as information processing systems.
- He cites Asimov's psychohistory and technological determinism as framing ideas.
05:05Setting initial conditions
How can an individual actually influence a transformative technology like AGI?
Brockman argues you can't hope to invent something no one else ever would, since everyone builds on the same giants. The only real degree of freedom is setting the initial conditions under which a technology is born, as with the internet's open academic culture or Wikipedia's decision not to run ads.
- Innovation is collective; individuals mainly change timelines.
- The internet's open, academic founding values shaped its next 40 years.
- Wikipedia's choice to avoid ads is cited as a similar example.
07:50AGI hopes and fears
What would Brockman ask a working AGI, and why do people focus on negative outcomes?
He says the first question to ask a powerful AGI is how to make sure things play out well, using it as one input alongside human perspectives. He thinks people fixate on negatives because transformative technologies are genuinely hard to picture, and it is always easier to destroy than to create.
- His first question to an AGI would be how to make sure it plays out well.
- AGI could accelerate cures, material abundance, and environmental cleanup.
- Negative scenarios are easier to argue than positive ones.
13:20OpenAI's three arms
How is OpenAI organized to keep AI development on a positive track?
OpenAI has three arms: capabilities doing the technical work, safety building technical mechanisms for alignment with human values, and policy addressing governance and whose values are represented. Brockman is encouraged that systems can learn human preferences from data, analogous to how a human child learns values from feedback.
- OpenAI is organized into capabilities, safety, and policy teams.
- Human preferences can potentially be learned from data, like a child learns values.
- The policy question of whose values is extremely hard given global cultural differences.
18:56Why AGI now: deep learning's three properties
Why did OpenAI believe AGI was worth pursuing after decades of disappointment?
Brockman says people took the wrong lesson from AI history: the perceptron was discredited after 1959 hype, but the 1980s revival came from larger computers, not new algorithms. Deep learning finally delivered in 2012 and has three key properties: generality, competence, and scalability, which together make AGI feel achievable for the first time.
- AGI became taboo after two AI winters.
- Deep learning has generality, competence, and scalability.
- Missing pieces like reasoning remain, but the paradigm gives hope.
26:56OpenAI LP and the charter
Why did OpenAI create a capped-profit company, and how does it stay true to its mission?
Building AGI requires many billions of dollars that a nonprofit cannot raise, so OpenAI created OpenAI LP with capped investor returns, with remaining value legally titled to the nonprofit. The charter, compiled over about a year, is the fiduciary duty of the organization, and the nonprofit's board governs the LP.
- OpenAI LP caps investor returns; excess value is legally titled to the nonprofit.
- The charter took about a year to compile with employee input.
- The fiduciary duty is to the charter, not to stakeholders.
40:53Competition vs collaboration and government
How does OpenAI handle the race dynamics of AGI development and the role of government?
Brockman worries that competitive races pressure teams to cut safety, so the charter commits OpenAI to assist rather than leapfrog any value-aligned front-runner, and he urges other serious players to make similar commitments. On government, OpenAI's current message is that it is time for measurement rather than regulation, though existing regulators should handle narrow AI applications like self-driving cars.
- OpenAI commits to helping rather than leapfrogging a value-aligned front-runner.
- Other AGI players should make similar commitments.
- Today's policy focus is measurement, not premature regulation.
45:10GPT-2 and responsible disclosure
Why did OpenAI withhold the full GPT-2 model?
Brockman explains that language models improve qualitatively with scale, and while GPT-2 could have gone either way, the split public reaction suggested caution was correct. He frames the decision as a test case for building norms of responsible disclosure in AI, analogous to what the security community took years to develop.
- GPT-2 was a scale-up of the June 2018 model and could have been released either way.
- If benefit is unclear, default to caution.
- AI lacks the security community's mature responsible disclosure norms.
Notes
Motivation and worldview
- Brockman is drawn to the digital world by iteration speed and leverage: a single individual with an idea can affect the entire planet.
- He views humans and society as information processing systems, and cites Asimov's psychohistory and technological determinism.
- Key insight: you cannot invent something no one else ever would; the only real degree of freedom is setting the initial conditions under which a technology is born (internet, Wikipedia).
OpenAI's structure
- Three arms: capabilities (technical progress), safety (alignment mechanisms), policy (governance and whose values).
- Technical safety: human preferences can be learned from data, just as a child learns values from feedback.
- OpenAI LP is a capped-profit company; excess value is legally titled to the nonprofit. The fiduciary duty is to the charter, not stakeholders.
- The charter took about a year to compile and includes commitments to avoid concentrating power and to assist rather than leapfrog a value-aligned front-runner.
Why AGI now
- The perceptron (1959) was overhyped and discredited; the 1980s neural net revival came from larger computers, not just backpropagation.
- Deep learning has three essential properties: generality, competence, and scalability.
- Missing pieces remain (e.g., reasoning), but for the first time there is a paradigm that gives hope AGI is achievable.
GPT-2 and responsible disclosure
- GPT-2 was a scale-up of the June 2018 GPT model; the release decision could have gone either way, and the split public reaction suggests caution was correct.
- Framed as a test case for responsible disclosure norms in AI, analogous to the security community's process.
- Distinguishing human from AI content online is ultimately a losing battle; reputation networks and real-world identity may help. The hard line is deception.
Reasoning and scale
- The real Turing test requires reasoning (e.g., learning calculus), not just language; scaling GPT-2 alone is unlikely to produce it because thinking uses variable compute.
- Agreement with Rich Sutton's lesson: general methods that leverage computation win, but ideas and scale are both needed.
- New reasoning team being started; theorem proving is an exciting benchmark.
Dota and self-play
- Dota was chosen for its messiness and continuous time; self-play lets two agents improve without bound.
- Scaled to roughly 100,000 CPU cores and hundreds of GPUs, hundreds of years of experience per day.
- Lost both games at The International but reached professional level; two weeks later a bot had an 80% win rate versus the one that played.
Speculation
- Simulation transfers to the real world (Dactyl robot trained with the Dota system).
- Consciousness may be a convenient computational shortcut; competent RL agents might therefore have it.
- On falling in love with an AI as in Her: "I hope so."
Text from the video's own captions. Summary and notes written by AI from the transcript, so check anything important against the recording.
More from MindVoice Production
- #208 Alexandr Wang - CEO, Scale AI
YouTube · 3 h 19 min
- #458 – Marc Andreessen: Trump, Power, Tech, AI, Immigration & Future of America
YouTube · 3 h 57 min
Recently transcribed
- Greg Brockman on what the best engineers and leaders do today
Allie K Miller · YouTube · 23 min
- Sacks, Andreessen & Horowitz: How America Wins the AI Race Against China
a16z · YouTube · 1 h 17 min