Astral Codex Ten

Locke

9 min read

Locke

Article

Locke is a recurring person in the Astral Codex Ten archive, appearing 2 times across 2 issues between June 07, 2022 and March 23, 2023. The archive places it in contexts such as “GPT-2 has been a monumental experiment in Locke’s hypothesis”; “philosophy, who are constantly getting jobs in (and doing well in) fields that don’t require you to compare Locke vs. Leibniz’s perspective on a priori truths”; “compare Locke vs. Leibniz’s perspective”. It most often appears alongside 1517, a priori truths, Abraham Lincoln.

Metadata

  • Category: People
  • Mention count: 2
  • Issue count: 2
  • First seen: June 07, 2022
  • Last seen: March 23, 2023

Appears In

Source Context

Recovered passages from the original issue text. When the raw archive preserved outbound links inside the source passage, they are listed directly under the quote.

My Bet: AI Size Solves Flubs
June 07, 2022 · Original source
In essence, GPT-2 has been a monumental experiment in Locke's hypothesis, and so far it has failed. Empiricism has been given every advantage in the world; thus far it hasn't worked. Even with massive data sets and enormous compute, the knowledge that it acquires has been superficial and unreliable.
Rather than supporting the Lockean, blank-slate view, GPT-2 appears to be an accidental counter-evidence to that view. Likewise, it doesn't seem like great news for the symbol-free thought-vector view, either. Vector-based systems like GPT-2 can predict word categories, but they don't really embody thoughts in a reliable enough way to be useful.
By “the Lockean, blank-slate view”, Marcus means the idea that you can just take a very big computer without any hard-coded “language instinct”, throw a bunch of language at it as training data, and then have it speak language correctly. Marcus is saying GPT-2 was a noble test of this hypothesis, but it failed, proving that something more is necessary.
Book Review: Paper Belt On Fire
March 23, 2023 · Original source
Probably it depends on the angle or something. Lindh was the only American to find Osama bin Laden in the early 2000s - he went to lots of jihadi training camps in the process of learning how to jihad, and Osama happened to be at one of them. The lesson, Walker says, is that if you want to find people who are hard to find, you need to steep yourself in their culture, truly understand them, become one with them. Good founders are hard to find. But he and Strachman went to dozens of dingy college dorms, math competitions, group houses, and hackathons, looking for people with the right sort of talent. After pooh-poohing IQ (“Marilyn vos Savant is listed as having the highest recorded IQ, and what does she do? She writes a column for a Sunday supplement in the newspaper”) he lists some of his own preferred metrics for judging would-be Thiel fellows and founders: Polytropon - a famously untranslatable Greek word (“of-many-turns”? “always-has-a-trick-up-his-sleeve” “clever bastard”?) used to describe Odysseus. Edge control - willingness to constantly surf the boundary between order and disorder Crawl-walk-run - ability to scale from a tiny startup to a big company. …and several others, including “tensive brilliance” and “Friday night Dyson sphere”. He and Danielle searched the country for people with these qualities, annoying colleges (he was banned from MIT after showing up too often to convince their students to drop out) and doing various stunts (on October 31 2017, the 500th anniversary of Luther’s theses, he nailed a list of anti-formal-education theses to the doors of the admin buildings of top colleges (“Our commercial printer had misunderstood our request and printed them on seven-foot-long scrolls. They were ridiculous . . . but it turned out for the best.”) At one point, he negotiated with a brilliant 21 year old who may have discovered a transformative diabetes therapeutic, but the hidebound conformist novelty-hating establishment refused to work with him just because he liked the Marvel Cinemat - okay, fine, he may have legally changed his name to “Tony Stark”. Still, Gibson saw past his eccentricities, helped him start his company, and gave him sage advice (he should introduce himself to other investors as “Anthony”). Skip through several more chapters of everyone hating Gibson and telling him he was wrong and refusing to give him money and cheating him out of the money he already had, and the payoff is Luminar. One of the dropouts they cultivated founded a beyond-cutting-edge lasers-for-self-driving-cars company which went public at $3 billion. 1517 made $200 million from the deal - it sounds like they had only ever raised about $25 million, so their investors must have octupled their money on that company alone. Everyone involved is now very rich, and Gibson considers his anti-education thesis on the way to being proven. The book ends with a newly-resourced Gibson continuing his quest to figure out whether and why the CIA killed his father, but it’s slow going. If any of you know a guy named Albert van Dam in Amsterdam, or how to convince Swiss banks to reveal secret account information, get in touch with him. II. A common pattern: I assert something. Everyone yells at me and tells me I’m wrong and stupid, sometimes in very colorful language. I wait, time proves me right, and I write an essay gloating educating people about this. The median comment is “of course this is true, nobody ever denied this was true, why are you wasting our time with something obvious?” I hate this and I try to avoid doing it to other people. This is too bad, because I’m tempted to say: obviously talented dropouts can start good companies. We’ve known this at least since Bill Gates dropped out of Harvard in 1975 to start Microsoft. But also, obviously they can. Brilliant and driven people can succeed whether they get a college education or not. If Bill Gates had stayed an extra two years at Harvard, he probably would have taken a few more advanced math classes not really related to programming software or running a company. So why should we even have as a hypothesis that he couldn’t start Microsoft successfully without doing that? Still, Gibson adequately proves that lots of people hated him and were sure he would fail. Either we should read this backwards - learn that there was once a time when pro-college messages were even stronger than now, so strong that people thought it was literally impossible to succeed without every single day of a four-year college application - or the critics were trying to get at something deeper they were bad at expressing. For example: what, exactly, is Gibson’s alternative to the education system? The back-of-book-blurb says Paper Belt On Fire is about “how higher education and other institutions must evolve to meet the dire challenges of tomorrow” - but evolve how? What exactly has been proven here? A few of the very brightest young people, hand-picked by an expert young-person-picker and given $100K, can become billionaires or make great discoveries without a college degree. What are the implications? Suppose you are an average college student with an average level of talent and motivation. Should you drop out and try to create a company for Peter Thiel? Based on how many average-talent people Thiel rejects, even he doesn’t think you should do that. And if you don’t have a good answer to this question - the one relevant to 99.9% of education system inmates - have you really launched a challenge to the educational system? Gibson doesn’t address this question, but I predict he would admit that, fine, he doesn’t have an alternative to the education system in the sense of “educate people this way rather than that way”. He just wants less formal education, and has proven this will work fine. True, he’s only proven it for a tiny subset of ultra-talented people. But “billionaire tech founder” is a hard job - if it wasn’t, more people would do it and reap the $1 billion reward. Proving that people can become billionaire tech founders without college degrees implicitly suggests they can be successful middle managers or budget analysts without college degrees. So the sort of companies that need middle managers and budget analysts should also consider hiring people without degrees, and the sorts of average-level-of-talent-and-motivation people who want these jobs should consider skipping college. Would this work? Probably. It worked in the early 1900s, when only 5-10% of Americans had college degrees but the country seemed about as dynamic and successful as it does now. It worked for people like George Washington, Abraham Lincoln, and Thomas Edison, none of whom went to college. It works in other countries - for example in the UK where young doctors skip undergrad and go straight to medical school, and whose patients get about the same outcomes as in the US. It works for people with impractical degrees like philosophy, who are constantly getting jobs in (and doing well in) fields that don’t require you to compare Locke vs. Leibniz’s perspective on a priori truths. So this would work if everyone agreed to do it at once, which they won’t. The way college gets you is adverse selection. Suppose that tomorrow, you - a smart and hard-working person who could easily get a college degree - decline to do so, because you appreciate Peter Thiel and Michael Gibson’s anti-institutional perspective. The pool of people without college degrees is now, to a first approximation: 200 million people who weren’t smart to get in, rich enough to afford it, or motivated enough to finish.
Inline links: his company, read this backwards