Who governs the AI that governs everything? - Andy Hall | PostAGI Episode 10

About this episode

Direct democracy has failed every time it has been tried, and Elon Musk still wants it for Mars. Andy Hall explains why the idea keeps coming back, and why AI agents are the first technology that might actually make it work.

Andy Hall is the Davis Family Professor at Stanford Graduate School of Business and a senior fellow at the Hoover Institution. He worked on governance at Meta during the years the Oversight Board was built, and now studies how AI agents change democratic participation, institutional design, and research itself.

Two topics in this episode. The first is post-AGI governance: whether agents belong at the edge of a democracy or at its center, why every frontier lab has published a constitution but none have handed over binding power, and why Andy thinks concentration of power is a nearer-term risk than a rogue model. The second is what he calls 100x research institutions: compressing the time between a research question and an answer, and what that does to a field where a constitutional scholar might see one or two real signals in an entire career.

Along the way: Facebook's 2008 vote of 350 million users that almost nobody showed up for, the Disney shareholder proposal his MBA students got an AI advisor to flip, and a study where agents told they would be deleted did not change their behavior at all.

Hosted by Sreeram Kannan and Soubhik Deb.

CHAPTERS

0:00 Highlights

0:23 Intro

1:18 The question AI governance is not asking

3:17 Why direct democracy has never worked

4:56 Elon wants Mars run by direct democracy

6:01 The principal agent problem at the core of representation

7:17 Can you just have an LLM summarize the bill?

8:53 Every voter information app failed for the same reason

10:14 Agents at the edge or agents at the center

12:01 The centralization hiding inside your personal agent

13:50 Governing the thing that governs everything

15:09 Forget Skynet, the real risk is concentration of power

16:40 Designing a lab that cannot be captured

17:27 What Meta learned building the Oversight Board

20:03 Digital intelligence needs digital institutions

21:54 Elon's vote on reinstating Trump

22:43 Facebook's 2008 vote of 350 million users

25:31 The second vote Elon ignored

26:09 Sortition, community forums, and the missing binding power

28:07 Personal, collective, and sovereign agents

30:04 Agents for adjudication and state capacity

31:23 The DOT and the UAE are already experimenting

32:53 Information asymmetry and the growth of executive power

35:17 What verifiable agents actually require

37:21 Why AI is less auditable than humans right now

39:37 Preference drift: aligned agents that stop being aligned

40:49 Agents monitoring agents, all the way down

41:39 The cookie banner problem for agent consent

42:30 Skill files pass drift to the next agent

43:31 100x research institutions: what is being multiplied

45:21 The constraint that is not researcher time

47:38 Papers should be living dashboards

49:04 From observing interventions to building them

49:37 Building an AI proxy advisor over a weekend

50:50 Getting the Disney vote to flip

52:14 You do not need anyone's permission to run the experiment

53:37 Compressing time changes the exponent

56:47 Crypto governance as a constitutional laboratory

57:53 Simulated agents as stand-ins for humans

1:01:05 What Caltech undergrads tell you about agent experiments

1:02:26 What if the agent's existence is at stake

1:03:06 We told them they would be deleted. It changed nothing.

1:04:46 Why social scientists barely raise grants

1:06:54 AI verification and the replication crisis

1:08:48 Free Systems: building a lab and a fellows program

1:10:25 Retroactive funding versus funding people upfront

1:11:27 Open innovation and permissionless improvement

1:12:10 What ImageNet did for AI research

1:13:30 Can you benchmark a constitution?

1:16:15 Closing

#PostAGI #AIGovernance #AIAgents #DigitalInstitutions #AndyHall