YouGov
Article
YouGov is a recurring organization in the Astral Codex Ten archive, appearing 7 times across 7 issues between June 08, 2022 and April 22, 2025. The archive places it in contexts such as “here’s a recent YouGov poll”; “How much does every country like every other’s country’s food? (source: YouGov)”; “Source: AI Policy Institute and YouGov, h/t Holly”. It most often appears alongside China, Cremieux, Elon Musk.
Metadata
- Category: Organizations
- Mention count: 7
- Issue count: 7
- First seen: June 08, 2022
- Last seen: April 22, 2025
Appears In
- Which Party Has Gotten More Extreme Faster?
- Links For September 2023
- Pause For Thought: The AI Pause Debate
- Links For November 2023
- Open Thread 349
- Links For November 2024
- Links For April 2025
Related Pages
-
- China (4 shared issues)
-
- Cremieux (3 shared issues)
-
- Elon Musk (3 shared issues)
-
- Europe (3 shared issues)
-
- OpenAI (3 shared issues)
-
- Twitter (3 shared issues)
-
- US (3 shared issues)
-
- AI (2 shared issues)
-
- AI Policy Institute (2 shared issues)
-
- Anthropic (2 shared issues)
-
- Austin (2 shared issues)
-
- Biden (2 shared issues)
External Links
Source Context
Recovered passages from the original issue text. When the raw archive preserved outbound links inside the source passage, they are listed directly under the quote.
Except: here’s a recent YouGov poll:
Inline links: here’s
18: How much does every country like every other’s country’s food? (source: YouGov)
Inline links: YouGov
For every word like "trust" or "worried", assume I mean "...enough to outweigh other considerations" Along with this overall arc, the debate included a few other points: Holly Elmore argued in The Case For AI Advocacy To The Public that pro-pause activists should be more willing to take their case to the public. EA has a long history of trying to work with companies and regulators, and has been less confident in its ability to execute protests, ads, and campaigns. But in most Western countries, the public hates AI and wants to stop it. If you also want to stop it, the democratic system provides fertile soil. Holly is putting her money where her mouth is and leading anti-AI protests at the Meta office in San Francisco; the first one was last month, but there might be more later. Source: AI Policy Institute and YouGov, h/t Holly Matthew Barnett said in The Possibility Of An Indefinite AI Pause that it might be hard to control the length of a pause once started, and might drag on longer than people who expected a well-planned surgical pause might like. He points to supposedly temporary moratoria that later became permanent (eg aboveground nuclear test ban, various bans on genetic engineering) and regulatory agencies that became so strict they caused the subject of their regulation to essentially cease to happen (eg nuclear plant construction for several decades). Such an indefinite pause would either collapse in a disastrous actualization of compute overhang, or require increasingly draconian international pressure to sustain. He thinks of this as a strong argument against most forms of pause, although he is willing to consider a “licensing” system that looks sort of like regulation. Quintin Pope said in AI Is Centralizing By Default, Let’s Not Make It Worse that the biggest threat from AI is centralizing power, either to dictators or corporations. AIs are potentially more loyal flunkies than humans, and let people convert power (including political power and money) into intelligence more efficiently than the usual methods. His interest is mostly in limiting the damage, putting him skew to most of the other people in this debate. He would support regulation that makes it easier for small labs to catch up to big ones, or that limits the power-centralizing uses of AI, but oppose regulation focused on centralizing AI power into a few big, supposedly-safer corporations. Percent of population in each country saying AI has more benefits than drawbacks. Pope uses this table to suggest AI regulation would be decentralizing, since the furthest-ahead countries are the most eager to regulate. Source: Ipsos; h/t Quintin II. For a “debate”, this lacked much inter-participant engagement. Most people posted their manifesto and went home. The exception was the comments section of Nora’s post, AI Pause Will Likely Backfire. As usual, a lot of the discussion was just clarifying what everyone was fighting about, but there were also a few real fights: Gerald Monroe thought that the history of nuclear weapons suggested pauses like this were impossible (because many countries did build nuclear weapons). David Manheim thought it suggested pauses like this could work (because there were some successful arms limitation treaties, and less nuclear proliferation than would have happened without international cooperation). Manheim also brought up the successful bans on ozone-destroying CFCs and on human cloning.
Inline links: The Case For AI Advocacy To The Public, leading anti-AI protests at the Meta office in San Francisco, https://substackcdn.com/image/fetch/$s_!vUmB!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4ebc8f9a-6c5a-4bd8-8542-358bd4fd0181_512x410.webp, The Possibility Of An Indefinite AI Pause, AI Is Centralizing By Default, Let’s Not Make It Worse, https://substackcdn.com/image/fetch/$s_!0Ae8!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F165f17cd-ca63-4f54-95e4-29f53b890578_1204x1126.webp, AI Pause Will Likely Backfire, thought
Source: AI Policy Institute and YouGov, h/t Holly Matthew Barnett said in The Possibility Of An Indefinite AI Pause that it might be hard to control the length of a pause once started, and might drag on longer than people who expected a well-planned surgical pause might like. He points to supposedly temporary moratoria that later became permanent (eg aboveground nuclear test ban, various bans on genetic engineering) and regulatory agencies that became so strict they caused the subject of their regulation to essentially cease to happen (eg nuclear plant construction for several decades). Such an indefinite pause would either collapse in a disastrous actualization of compute overhang, or require increasingly draconian international pressure to sustain. He thinks of this as a strong argument against most forms of pause, although he is willing to consider a “licensing” system that looks sort of like regulation. Quintin Pope said in AI Is Centralizing By Default, Let’s Not Make It Worse that the biggest threat from AI is centralizing power, either to dictators or corporations. AIs are potentially more loyal flunkies than humans, and let people convert power (including political power and money) into intelligence more efficiently than the usual methods. His interest is mostly in limiting the damage, putting him skew to most of the other people in this debate. He would support regulation that makes it easier for small labs to catch up to big ones, or that limits the power-centralizing uses of AI, but oppose regulation focused on centralizing AI power into a few big, supposedly-safer corporations. Percent of population in each country saying AI has more benefits than drawbacks. Pope uses this table to suggest AI regulation would be decentralizing, since the furthest-ahead countries are the most eager to regulate. Source: Ipsos; h/t Quintin II. For a “debate”, this lacked much inter-participant engagement. Most people posted their manifesto and went home. The exception was the comments section of Nora’s post, AI Pause Will Likely Backfire. As usual, a lot of the discussion was just clarifying what everyone was fighting about, but there were also a few real fights: Gerald Monroe thought that the history of nuclear weapons suggested pauses like this were impossible (because many countries did build nuclear weapons). David Manheim thought it suggested pauses like this could work (because there were some successful arms limitation treaties, and less nuclear proliferation than would have happened without international cooperation). Manheim also brought up the successful bans on ozone-destroying CFCs and on human cloning.
Inline links: The Possibility Of An Indefinite AI Pause, AI Is Centralizing By Default, Let’s Not Make It Worse, https://substackcdn.com/image/fetch/$s_!0Ae8!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F165f17cd-ca63-4f54-95e4-29f53b890578_1204x1126.webp, AI Pause Will Likely Backfire, thought
I admit I’m surprised by this! The poll was funded by the AI Policy Institute, but it seems to have been conducted through YouGov, and the results are stable to various different framings of the question. Maybe people don’t actually think about extinction in real life, but if the pollsters bring it up, people will agree that it sounds like a bad thing? Or who knows, maybe they’re really worried.
Inline links: through YouGov, various different framings of the question
1: On last week’s post How Often Do Men Think About Rome, I presented ACX survey data showing that men and women thought about Rome the same amount. Commenter RenOS was able to find a YouGov poll showing the opposite (men more). Possible interpretations: my poll was contaminated by selection bias (ACX-reading women are unusually interested in history), theirs was contaminated by response bias (they asked how often you thought about Rome; I asked whether you thought about it in the last 24 hours - I think their version leaves more room for retroactive editing of memories). YouGov also provided other interesting historical information:
3: YouGov (spotted via Polling USA) asking some of the important questions (1, 2, 3, 4):
19: Lyman Stone Continues Being Dumb, The Fallacious Inferences Of Lyman Stone, and Against Lyman Stone are some of this month’s top anti-Lyman-Stone content. 20: New polling on the Middle Ages: 21: More new-ish AI policy substacks potentially worth your time: You may remember Helen Toner from the OpenAI board drama, but she’s also an experienced and thoughtful scholar on AI policy and now has a Substack, Rising Tide. I especially appreciated Nonproliferation Is The Wrong Approach To AI Misuse.
Inline links: Lyman Stone Continues Being Dumb, The Fallacious Inferences Of Lyman Stone, Against Lyman Stone, New polling on the Middle Ages, https://substackcdn.com/image/fetch/$s_!9b_4!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe3163eca-eaf4-492a-ac68-eadefa169be2_632x419.png, Rising Tide, Nonproliferation Is The Wrong Approach To AI Misuse
The article doesn’t explain why the board did such a poor job communicating their grievances, maybe it’s in the full book. It does sound like part of board’s problem was that they were leaning heavily on Mira Murati but she was playing both sides off against each other. 23: And the Forethought Institute has been putting out some great analysis lately, including Will AI R&D Automation Cause An Intelligence Explosion?, by Daniel Eth and Tom Davidson, and AI Enabled Coups: How A Small Group Could Use AI To Seize Power, by Tom Davidson, Lukas Finnveden, and Rose Hadshar. And here’s Davidson defending the coups paper on the 80,000 Hours podcast. 24: Agent Village is a sort of "reality show” where a group of AI agents has to work together to complete some easy-for-human tasks (currently: pick a charity and raise money for it) and you get to watch. 25: University of Austin promises approximately-automatic admission to anyone with a 1460+ on their SATs (or similar scores on other standardized tests). 26: Cremieux on birth order effects (X). His conclusion: “The birth order effect is social. It is driven by parental interactions and investments, and sibling interactions that are dynamic with respect to age.” 27: Claim from new paper, via Alex Tabarrok: “Prohibiting the FDA from regulating e-cigarettes reduced smoking attributable mortality by nearly 10% on average each year from 2011-2019 for a total savings of some 677,000 life-years, or approximately 1/3 the estimated benefit of early HIV/AIDS drugs through year 2000”. Related: FDA will not regulate lab-developed tests for the near future. 28: Bryan Caplan on Natal Con, the pronatalist conference in Austin. My strongest opinion on this is that they should either change the name or hold the next one in Natal, Brazil. 29: Am I living in a conservative filter bubble? I keep hearing how we need a “reckoning” over the government’s disastrous anti-COVID policies, but the latest YouGov polling suggests that large majorities of Americans continue to support those policies: 30: A California legislator proposed a bill that would ban OpenAI’s nonprofit → forprofit conversion, backed by a suspiciously specific interest group, the Coalition For AI Nonprofit Integrity. I assume this is either Elon Musk or our conspiracy; not sure which. But their plan was stymied when the legislature “amended” the bill to remove its entire text and replace it with unrelated text about airplane loans. The legislator apparently got cold feet after being warned it might inflict collateral damage on other companies, and because of the way the California legislature works it’s sometimes more efficient to turn doomed bills into other bills than to simply withdraw them. 31: EthnoGuessr is a GeoGuessr variant: it shows you pictures of an ethnic group, you click on the map where you think they’re from. Warning that if you play this too much you might get into race science. Their source, humanphenotypes.net, divides humanity into a hundred or so ethnic groups. Although they cite sources, I don’t understand the philosophical basis of the classification. Also, 100 images is so few that you start memorizing them after a while. I hope they move on to real pictures of real people in naturalistic situations. Remember, asking where someone is from ‘originally’ is a microaggression, but inferring it yourself based on their “mildly platyrrhine, high-rooted nose” is A-OK! 32: Farmkind has a new version of their calculator to determine meat offsets, eg how much do you have to donate to animal welfare charities to compensate for the animals you harm by eating meat. Does the average person really eat chicken 9x a week? 33: Not going to waste your time listing every bad thing Trump has done this month, but among the worst is sending innocent people to horrible Salvadorean prisons (including one person picked up because he had an autism awareness tattoo in honor of his brother, which they mistook for a gang tattoo), then refusing to bring them back. I have seen a couple of people defend denying immigrants due process; I assume they will not be moved by humanitarian arguments, but I think there are some more practical considerations: Zaid Jilani points out that if immigrants don’t get a right to due process, citizens also don’t get a right to due process, because the government can kidnap citizens, claim they’re immigrants, and the citizens can’t prove otherwise since they don’t get due process.
Inline links: https://substackcdn.com/image/fetch/$s_!WFgK!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6448a778-3290-4c85-9480-d4f78f9be960_916x255.png, Will AI R&D Automation Cause An Intelligence Explosion?, AI Enabled Coups: How A Small Group Could Use AI To Seize Power, here’s, Agent Village, promises approximately-automatic admission, Cremieux on birth order effects (X), new paper, Alex Tabarrok, FDA will not regulate lab-developed tests for the near future, Bryan Caplan on Natal Con, Natal, Brazil, the latest YouGov polling, https://substackcdn.com/image/fetch/$s_!HGBp!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd049433b-1cf5-442a-9d17-4be3a7846d61_760x370.png, Coalition For AI Nonprofit Integrity, “amended”, the way the California legislature works, EthnoGuessr, https://substackcdn.com/image/fetch/$s_!Y3AO!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbde5185a-2b93-4c07-904b-66d2c2311a53_1140x1033.png, humanphenotypes.net, a new version of their calculator, including, Zaid Jilani
Backlinks
- AI Policy Institute
- Data Colada
- Francesca Gino
- Joseph Smith
- Links For April 2025
- Links For November 2023
- Links For November 2024
- Links For September 2023
- North Atlantic
- Open Thread 349
- Organizations: A
- Organizations: Y
- Pause For Thought: The AI Pause Debate
- Which Party Has Gotten More Extreme Faster?