A deep dive into the philosophy of computation, the dangers of AI-driven manipulation, and the necessity of removing Turing completeness from software stacks to achieve true reasoning.
In one sentence
The path to true artificial intelligence and reliable software lies in reducing complexity—specifically by removing Turing completeness from the software stack—while acknowledging that the greatest risks of AI are not inherent to the machines, but to the humans who wield them.
Why read this (and who it's for)
This conversation is for engineers, researchers, and thinkers who want to move past the "hype" of LLMs and into the structural reality of computation. It solves the problem of "how do we actually build something reliable?" by providing a framework for architectural simplicity. You will be able to argue for and design systems that are mathematically verifiable and reason-capable, rather than just probabilistic.
The big idea
George Hotz argues that our current approach to software and AI is fundamentally flawed because we are building on top of "Turing complete" stacks. Because a Turing-complete system can theoretically do anything (including the Halting Problem), it is impossible to fully reason about what a program will do before you run it. Hotz proposes a radical shift: stripping away Turing completeness from every layer of the stack—from Python to C++ to the hardware kernels. By doing so, we move into the realm of "ADMO" (Arithmetic, Data, Memory, and Operations) machines, where we can finally reason about and predict system behavior.
Furthermore, Hotz posits that the "scary" part of AI isn't a sentient robot uprising; it is the fact that humans are uniquely susceptible to manipulation. He argues that a super-intelligent agent won't need to "attack" us; it will simply optimize our dopamine loops (like TikTok) to the point of "amusing ourselves to death." The solution, he suggests, is decentralization: ensuring that the power of these models is distributed among everyone rather than held by a small, trusted group of "authorities."
Key ideas
The Curse of Turing Completeness
- What it is — The idea that by making every layer of our software stack Turing complete, we inherit the Halting Problem, making it impossible to guarantee what a piece of code will do.
- Why it matters — If you can't reason about a system's limits, you can't truly "solve" complex problems reliably; you can only hope it works.
- In the book — Hotz explains that because of Turing completeness, branch predictors in CPUs are only 99% accurate because the 1% is the "halting problem"—you simply cannot know what happens next.
The "Mid" Intelligence of LLMs
- What it is — Hotz argues that current LLMs, based on categorical cross-entropy (predicting the next token), are "mid" because they maximize compression rather than actual reasoning.
- Why it matters — To reach AGI, we need reinforcement learning (RL) in complex environments, not just better "prediction" of the next word.
- In the book — He compares LLM-generated rap to "YouTube comment raps"—it's technically correct but lacks the depth of true human-level intelligence.
The Dopamine Trap (Amusing Ourselves to Death)
- What it is — The theory that the greatest threat to humanity is not a "Terminator" scenario, but a "Brave New World" scenario where we are manipulated into a state of permanent, passive consumption.
- Why it matters — It shifts the AI safety conversation from "robot rebellion" to "human fragility."
- In the book — Hotz references Infinite Jest, describing a "tape" so compelling you'd do anything to watch it again. He argues that generative AI will eventually create the "TikTok" that makes this a reality.
Decentralization as Safety
- What it is — The belief that the safest way to handle powerful AI is to ensure everyone has access to it, rather than a small group of "trusted" authorities.
- Why it matters — Centralized power in the hands of a few with "super-intelligent" tools is a greater risk than a world where everyone has an "ad-blocker" for reality.
- In the book — Hotz argues that while he is scared of the potential for harm, he is much less scared of a decentralized future where individuals can use AI to filter out "PSYOPs" and noise.
The "Transparent Dictatorship" of Engineering
- What it is — A management philosophy where the technical leadership is absolute and transparent, but the "exit" is always free.
- Why it matters — It allows for the rapid, uncompromising refactoring of complex systems (like Twitter's codebase) without the "softness" of corporate politics.
- In the book — Hotz describes his leadership at Comma as a "transparent dictatorship" where the values are clear and the best programmers are empowered to lead.
Frameworks & tools
The "Anti-Turing" Stack
To build systems that are actually reason-capable and predictable, Hotz suggests a radical architectural shift:
- Identify the Layers: Map out your entire stack (Language $\rightarrow$ Runtime $\rightarrow$ Kernel $\rightarrow$ Hardware).
- Identify the "Turing" Bloat: Locate where the system allows for arbitrary branching and branching-prediction (the source of the Halting Problem).
- Strip to ADMO: Replace those layers with machines that only perform Arithmetic, Data, Memory, and Operations.
- Verify: Once Turing completeness is removed, you can reason about the system's behavior because the Halting Problem no longer applies.
The "Human-Centric" AI Safety Model
Instead of focusing on "Alignment" (making the AI do what we want), focus on "Defense":
- Identify the Manipulation: Recognize where AI is being used to manipulate human dopamine (e.g., social media algorithms).
- Build the "Ad-Blocker": Use AI to create a layer of protection between the human and the manipulated information.
- Decentralize: Ensure the tools for this defense are available to everyone, not just a few corporations.
Memorable examples & stories
The "Mid" Rap Comparison
Hotz tried to get ChatGPT to write rap lyrics and found the results were "cringey" and "mid"—the equivalent of a YouTube comment.
Lesson: Prediction is not the same as understanding.
The "Ad-Blocker" for Reality
Hotz imagines a world where a powerful AI acts as a personal "PSYOP" filter, identifying and blocking manipulative content or ads in real-time.
Lesson: The ultimate utility of AI may be as a shield against other, more powerful AI-driven manipulations.
The "Nuclear Weapon" Analogy
When asked why AI won't just kill everyone (the Yudkowsky view), Hotz points to nuclear weapons: they aren't used for "total destruction" because you can't use an irradiated wasteland for resources.
Lesson: Strategic value lies in subjugation and dominance, not total eradication. AI will likely be used for the former.
Key quotes
"I think the most obvious way [humanity ends] is wire heading. We end up amusing ourselves to death. We end up all staring at that infinite TikTok and forgetting to eat."
Why it matters: It frames the existential threat as a loss of agency rather than a physical attack.
"I want to get Turing completeness outta the stack entirely. Because once you get rid of Turing completeness, you can reason about things."
Why it matters: This is the core engineering thesis for creating reliable, verifiable systems.
"I'm not worried about alignment between AI company and their machines. I'm worried about alignment between me and AI company."
Why it matters: It shifts the focus of safety from the "machine" to the "human" who owns the machine.
"The machine is not interested in hurting humans. The machine is a machine. But the human gets the machine and there's a lot of humans out there very interested in manipulating you."
Why it matters: It identifies the human element as the primary variable in AI safety.
How to apply it
This week
- Audit your "Cringe" Code: Look at a piece of code you wrote recently. Ask: "Is this the simplest way to do this, or did I just copy a complex pattern because it felt familiar?"
- Identify your "TikTok": Identify one area of your life where an algorithm is currently "amending" your dopamine. Decide to spend 30 minutes in a "dumb" environment (no-algorithm) to recalibrate.
Ongoing
- The Simplicity Rule: Before adding a new library or a complex feature, ask: "Can I do this without a Turing-complete abstraction?"
- The "Defense" Mindset: When thinking about AI, stop asking "Can it think?" and start asking "How can I use this to protect my attention and agency?"
Common pitfalls
- The "Alignment" Trap: Don't get distracted by the philosophical debate of whether an AI can "feel" things. Hotz argues that consciousness is a "smilie face on a rock"—a human projection. Focus on what the system does and how it affects human behavior.
- The "Magic" of LLMs: Do not assume that more parameters or more data will lead to AGI. Hotz argues that without a change in the fundamental loss function (moving beyond cross-entropy), you are just building a better "prediction" machine, not a "reasoning" machine.
Connects to
- The Alignment Problem (Brian Christian): Challenges the standard "alignment" narrative by suggesting that human-to-human manipulation is the primary threat.
- The Age of AI (Kissimmee, et al.): Complements the technical discussion on hardware and the "compute" requirements for AGI.
If you remember only three things
- Remove Turing Completeness: To build reliable systems, you must be able to reason about them; you can only do that if you remove the ability for the system to do "anything."
- The Dopamine Threat: The real danger of AI is its ability to perfectly manipulate the human dopamine system, leading to a "Brave New World" of passive consumption.
- Decentralization is Safety: The best defense against a super-intelligent, manipulative AI is to ensure that the power of that AI is distributed among everyone, not held by a few.
Internalize it
- Reflection questions
- If I stripped away all the "magic" and "hype" from my current projects, what is the actual, boring, mathematical core of what I am trying to build?
- In what ways is my own attention being "managed" by algorithms, and what would happen if I took that "knob" away?
- If I can't reason about a system's behavior because it's too complex, am I actually in control of it, or am I just hoping it doesn't break?
- Flashcards
Q: Why does Hotz want to remove Turing completeness from the software stack?
A: Because Turing-complete systems are subject to the Halting Problem, making it impossible to reason about what they will do before they run.
Q: What is the "Mid" quality of current LLMs?
A: They are based on categorical cross-entropy (prediction/compression) rather than the reinforcement learning (RL) required for true reasoning.
Q: What is the "Brave New World" threat of AI?
A: The risk of humans being "amused to death" by AI-generated content that perfectly manipulates our dopamine loops.
Q: How does Hotz view the "Alignment" problem?
A: He is less worried about AI-to-human alignment and more worried about human-to-AI-company alignment (how humans use the tools).
Q: What is a "Transparent Dictatorship" in a company?
A: A management style where technical leadership is absolute and values are transparent, but the employee's exit is always free.
Fidelity note
This summary is grounded in the provided transcript. I am confident in the technical descriptions of "Turing Completeness" and "ADMO" as Hotz describes them. The section on "AI Safety" is strictly based on Hotz's specific distinction between "machine-led" and "human-led" manipulation. The transcript does not provide a formal "ADMO" definition, but Hotz describes it as the alternative to Turing completeness.