Astral Codex Ten

David Manheim

11 min read

David Manheim

Article

David Manheim is a recurring person in the Astral Codex Ten archive, appearing 5 times across 5 issues between February 03, 2022 and October 05, 2023. The archive places it in contexts such as “The founder, David Manheim, has a PhD in public policy”; “13: David Manheim writes :”; “Contact: David Manheim, David[at]alter[dot]org[dot]il”. It most often appears alongside ACX, India, Athens.

Metadata

  • Category: People
  • Mention count: 5
  • Issue count: 5
  • First seen: February 03, 2022
  • Last seen: October 05, 2023

Appears In

Source Context

Recovered passages from the original issue text. When the raw archive preserved outbound links inside the source passage, they are listed directly under the quote.

ACX Grants ++: The First Half
February 03, 2022 · Original source
#44: Long-Termism Advocacy Org In Israel ALTER, the Associations for Long Term Existence and Resilience, is an academic research and advocacy organization being started in Israel, which hopes to investigate, demonstrate, and foster useful ways to improve the future in the short term, and to safeguard and improve the long-term trajectory of humanity. The founder, David Manheim, has a PhD in public policy and a track record of research in effective altruist priority areas and risk reduction, and in policy engagement. The key goals of the organization will be to foster academic and policy work in key areas in Israel, via organizing conferences, academic engagement, and fostering collaboration with international organizations in this space. If you have connections to interested Israeli academics, experience with making this type of academic outreach successful, or you can provide funding for this work, please contact david@alter.org.il.
Highlights From The Comments On The Repugnant Conclusion And WWOTF
August 25, 2022 · Original source
13: David Manheim writes:
Inline links: writes
Meetups Everywhere 2022: Times & Places
August 26, 2022 · Original source
BAGHDAD, IRAQ Contact: MA, tofiahmed117[at]gmail[dot]com, Discord: WolframSigma#1532, Telegram Time: Friday, September 2, 11:00 AM Location: Grinders Coffeeshop Coordinates: 8H568FG6+73 Event link(s): LessWrong JERUSALEM, ISRAEL Contact: Zvi Schreiber, zvi[at]zvi[dot]net, WhatsApp +972 54 569 1100 Time: Wednesday, October 19, 6:00 PM Location: Malcha technology park garden Coordinates: 8G3QP5XP+PP Event link(s): LessWrong REHOVOT, ISRAEL Contact: David Manheim, David[at]alter[dot]org[dot]il Time: Sunday, September 11, 8:00 PM Location: Outside porch of Aroma Coffee, הרצל 218, רחובות Coordinates: 8G3PWR25+MP Event link(s): LessWrong, Facebook event Notes: Please RSVP on Facebook so we can give updates if needed TEL AVIV, ISRAEL Contact: Adam & inbar M, projectscentrum[at]gmail[dot]com, inbar192[at]gmail[dot]com, Whatsapp +46762791415 (Adam) Time: Sunday, September 4, 7:00 PM Location: Hamenia industrial loft at Beit Alfa 7 (רחוב בית אלפא 7). Look for a door with ACX sign. Two floors up. Coordinates: 8G4P3Q8Q+85 Event link(s): LessWrong Group info: We've just made a Facebook group and are planning to organize monthly meetings going forward Notes: For questions contact Adam on email or WhatsApp. Feel free to bring a snack or a bottle of white wine. AMMAN, JORDAN Contact: Daniel, dnledvs[at]gmail[dot]com Time: Tuesday, September 20, 6:30 PM Location: Rustic, Jabal al Weibdeh Coordinates: 8G3QXW49+WG Event link(s): LessWrong Notes: We're hoping to grow the group, so feel free to come even if you've only read a few posts! +1s are also welcome. CAPE TOWN, SOUTH AFRICA Contact: Mark Chimes, chimes[dot]mark[at]gmail[dot]com, WhatsApp 0826568573 Time: Saturday, September 17, 11:00 AM Location: Truth Coffee Roasting, 36 Buitenkant St, Cape Town City Centre - we'll put a sign on the table Coordinates: 4FRW3CFF+3M Event link(s): LessWrong Group info: We met up pre-Covid and pre-ACX as an SSC group. Now we're getting back in the swing of things. We eat lunch and chat about philosophy, politics, and sometimes SSC/ACX blog posts. Notes: We're planning on having another meetup on the 8th October if you can't make the first. DAR ES SALAAM, TANZANIA Contact: Arno, arnorohwedder[at]gmail[dot]com, +255763998637 Time: Thursday, September 29, 7:30 PM Location: The Deck, Masaki Coordinates: 6G5X776J+X6 Event link(s): LessWrong Notes: Seeing if there are any interested people in Dar, look forward to meeting, if you are coming please send me a whatsapp. DUBAI, UAE Contact: RS, xyxyxz[at]gmail[dot]com, +971552726281 (WhatsApp) Time: Friday, September 30, 7:30 PM Location: Starbucks, Garhoud Coordinates: 7HQQ68VR+94 Event link(s): LessWrong Group info: Met once before Notes: Please RSVP on LessWrong, or message me on WhatsApp
Inline links: Telegram, 8H568FG6+73, LessWrong, 8G3QP5XP+PP, LessWrong, 8G3PWR25+MP, LessWrong, Facebook event, 8G4P3Q8Q+85, LessWrong, Facebook group, 8G3QXW49+WG, LessWrong, 4FRW3CFF+3M, LessWrong, 6G5X776J+X6, LessWrong, 7HQQ68VR+94, LessWrong
Open Thread 258
January 08, 2023 · Original source
4: Comment of the week: Lars Doucet tries to defend the claim in the recent Bay Area House Party post that the moneychangers in the Temple were a housing problem (see also David Manheim and Robert Jones’ replies, and the threads underneath them). Also, Adam Strandberg corrects me: there are at least three immortal mammals, although the third one is also a Tasmanian Devil.
Inline links: tries to defend the claim, David Manheim, Robert Jones, corrects me
Pause For Thought: The AI Pause Debate
October 05, 2023 · Original source
HOW LONG TO PAUSE. The biggest disadvantage of pausing for a long time is that it gives bad actors (eg China)1 a chance to catch up. Suppose the West is right on the verge of creating dangerous AI, and China is two years away. It seems like the right length of pause is 1.9999 years, so that we get the benefit of maximum extra alignment research and social prep time, but the West still beats China. Obviously the problem with the Surgical Pause is that we might not know when we’re on the verge of dangerous AI, and we might not know how much of a lead “the good guys” have. Surgical Pause proponents suggest being very conservative with both free variables. This is less of a well-thought-out plan and more saying “come on guys, let’s at least try to be strategic here”. At the limit, it suggests we probably shouldn’t pause for six months, starting right now. Since this involves leading labs burning their lead time for safety, in theory it could be done unilaterally by the single leading lab, without international, governmental, or even inter-lab coordination. But you could buy more time if you got those things too. Some leading labs have promised to do this when the time is right - for example OpenAI and (a previous iteration of) DeepMind - with varying levels of believability. AnonResearcherAtMajorAILab discussed some of the strategy here in Aim For Conditional AI Pauses, and this Less Wrong post is also very good. Regulatory Pause: If one benefit of the Simple Pause is to use the time to prepare for AI socially and politically, maybe we should just pause until we’ve completed social and political preparations. David Manheim suggests a monitoring agency like the FDA. It would “fast-track” small AIs and trivial re-applications of existing AIs, but carefully monitor new “frontier models” for signs of danger. Regulators might look for dangerous capabilities by asking AIs to hack computers or spread copies of themselves, or test whether they’ve been programmed against bias/misinformation/etc. We could pause only until we’ve set up the regulatory agency, and take hostile actions (like restrict chip exports) only to other countries that don’t cooperate with our regulators or set up domestic regulators of their own. Many people in tech are regulation-skeptical libertarians, but proponents point out that regulation fails in a predictable direction: it usually does successfully prevent bad things, it just also prevents good things too. Since the creation of the Nuclear Regulatory Commission in 1975, there has never been a major nuclear accident in the US. And sure, this is because the NRC prevented any nuclear plants from being built in the United States at all from 1975 to 2023 (one was finally built in July). Still, they technically achieved their mandate. Likewise, most medications in the US are safe and relatively effective, at the cost of an FDA approval process being so expensive that we only get a tiny trickle of new medications each year and hundreds of thousands of people die from unnecessary delays. But medications are safe and effective. Or: San Francisco housing regulators almost never approve new housing, so housing costs millions of dollars and thousands of San Franciscans are homeless - but certainly there’s no epidemic of bad houses getting approved and then ruining someone’s view or something. If we extrapolate this track record to AI, AI regulators will be overcautious, progress will slow by orders of magnitude or stop completely - but AIs will be safe. This is a depressing prospect if you think the problems from advanced AI would be limited to more spam or something. But if you worry about AI destroying the world, maybe you should accept a San-Francisco-housing-level of impediment and frustration. A regulatory pause could be better than a total stop if you think it will be more stable (lots of industries stay heavily regulated forever, and only a few libertarians complain), or if you think maybe the regulator will occasionally let a tiny amount of safe AI progress happen. But it could be worse than a total stop if you expect continued progress will eventually produce unsafe AIs regardless of regulation. You might expect this if you’re worried about deceptive alignment, eg superintelligent AIs that deliberately trick regulators into thinking they’re safe. Or you might think AIs will eventually be so powerful that they can endanger humanity from a walled-off test environment even before official approval. The classic Bostrom/Yudkowsky model of alignment implies both of these things. David Manheim and Thomas Larsen set out their preferred versions of this strategy in What’s In A Pause? and Policy Ideas For Mitigating AI Risk. Total Stop: If you expect AIs to exhibit deceptive alignment capable of fooling regulators, or to be so dangerous that even testing them on a regulator’s computer could be apocalyptic, maybe the only option is a total stop. It’s tough to imagine a total stop that works for more than a few years. You have at least three problems: NON-PARTICIPANTS. As with any pause proposal, unfriendly countries (eg China) can keep working on AI. You can refuse to export chips to them, which will slow them down a little, but their own chips will eventually be up to the task. You will either need a diplomatic miracle, or willingness to resort to less diplomatic forms of coercion. This doesn’t have to be immediate war: Israel has come up with “creative” ways to slow Iran’s nuclear program, and countries trying to frustrate China’s chip industry could do the same. But great powers playing these kinds of games against each other risks wider conflict.
Inline links: 1, OpenAI, DeepMind, Aim For Conditional AI Pauses, this Less Wrong post, look for dangerous capabilities, finally built, What’s In A Pause?, Policy Ideas For Mitigating AI Risk
Gerald Monroe thought that the history of nuclear weapons suggested pauses like this were impossible (because many countries did build nuclear weapons). David Manheim thought it suggested pauses like this could work (because there were some successful arms limitation treaties, and less nuclear proliferation than would have happened without international cooperation). Manheim also brought up the successful bans on ozone-destroying CFCs and on human cloning.
Inline links: thought
Nora thought most treaties like this fail, and a successful one would have to involve some level of global tyranny. David Manheim thought most treaties sort of do some good, even if they don’t accomplish exactly what they wanted, and none of them so far have led to global tyranny. Cf. the Kellogg-Briand Pact for an example of a treaty that didn’t succeed perfectly but was probably net good.
Inline links: thought, the Kellogg-Briand Pact