Clearer Thinking
Article
Clearer Thinking is a recurring organization in the Astral Codex Ten archive, appearing 3 times across 3 issues between November 04, 2022 and March 20, 2024. The archive places it in contexts such as “They have deals going with… Clearer Thinking”; “Clearer Thinking received an ACX Grant to replicate psychology results at scale”; “Clearer Thinking is testing that now by trying to replicate 40 intelligence-related claims”. It most often appears alongside Spencer Greenberg, 1DaySooner, acanthamoeba keratitis.
Metadata
- Category: Organizations
- Mention count: 3
- Issue count: 3
- First seen: November 04, 2022
- Last seen: March 20, 2024
Appears In
Related Pages
-
- Spencer Greenberg (2 shared issues)
-
- 1DaySooner (1 shared issues)
-
- acanthamoeba keratitis (1 shared issues)
-
- ACT (1 shared issues)
-
- ACX (1 shared issues)
-
- ACX Grantees Discord (1 shared issues)
-
- ACX Grants (1 shared issues)
-
- ACX Survey (1 shared issues)
-
- ACXG+ Grant (1 shared issues)
-
- African Swine Fever (1 shared issues)
-
- Alex Hoekstra (1 shared issues)
-
- Alice Evans (1 shared issues)
External Links
Source Context
Recovered passages from the original issue text. When the raw archive preserved outbound links inside the source passage, they are listed directly under the quote.
33: SD’s Neutrino Research (5/10) SD says his neutrino thesis is going well, and he is applying for graduate programs in neutrino physics. 34: User-Created Prediction Markets (9/10) Manifold Markets wanted to create a new prediction market platform where anyone could post questions. They’ve since pivoted to play money and raised $2.4 million in grants and seed funding, with about 10,000 different markets and 300 daily average users. I and many of my friends visit their site daily or at least weekly, and I often link them on Mantic Mondays. They have deals going with the Salem Center at University of Texas, Clearer Thinking, and various EA groups.
Inline links: Manifold Markets
15: Rapid Replications Of New Psychology Papers (6/10) Spencer Greenberg and his ClearerThinking.org org want to attempt to replicate psychology papers shortly after they are published in the most prestigious journals to help improve scientific incentives. They say they’ve finished their first three replications and are working on launching the site (at which point those first three will become publicly available and they’ll keep working on others). ETA two months or so.
Inline links: ClearerThinking.org
5: Clearer Thinking received an ACX Grant to replicate psychology results at scale. They write:
We launched a new project (which received an ACX Grant) to help improve the replication crisis in psychology: Transparent Replications by Clearer Thinking! We're aiming to vastly increase the probability of studies in top journals being replicated in order to change researcher incentives. As soon as new psychology and behavior papers come out in Nature and Science (the two most prestigious general science journals), our plan is to replicate a study from nearly every one of them. Additionally, we'll be replicating randomly selected studies from PNAS, JPSP, and PSci shortly after they are released. You can check out our first three replications now!
Conventional wisdom is that intelligence-related studies replicate better than other fields, and Clearer Thinking is testing that now by trying to replicate 40 intelligence-related claims. They’re looking for experimental subjects to take their online tests; click here if you want to help. They promise you a breakdown of your cognitive strengths and weaknesses at the end, but be aware they won’t tell you your IQ and will only tell you percentile values relative to the other (highly selected) people who took their tests. Also, the Science Comprehension test is much more intense than the previous few; be prepared to put in a lot of thought if you don’t skip that one. Don’t exhaust yourself so much that you refuse to take the ACX Survey in a few weeks!
Inline links: click here
I have data from two big Internet surveys, Less Wrong 2014 and Clearer Thinking 2023. Both asked questions about IQ:
Inline links: Less Wrong 2014, Clearer Thinking 2023
The average ClearerThinking user reported their IQ as 130.
The average ClearerThinking user reported their IQ as 130. These are implausibly high. Only 1/200 people has an IQ of 138 or higher. 1/50 people have IQ 130, but the ClearerThinking survey used crowdworkers (eg Mechanical Turk) who should be totally average. Okay, fine, so people lie about their IQ (or foolishly trust fake Internet IQ tests). Big deal, right? But these don’t look like lies. Both surveys asked for SAT scores, which are known to correspond to IQ. The LessWrong average was 1446, corresponding to IQ 140. The ClearerThinking average was 1350, corresponding to IQ 134. People seem less likely to lie about their SATs, and least likely of all to optimize their lies for getting IQ/SAT correspondences right. And the Less Wrong survey asked people what test they based their estimates off of. Some people said fake Internet IQ tests. But other people named respected tests like the WAIS, WISC, and Stanford-Binet, or testing sessions by Mensa (yes, I know you all hate Mensa, but their IQ tests are considered pretty accurate). The subset of about 150 people who named unimpeachable tests had slightly higher IQ (average 140) than everyone else. Thanks to Spencer Greenberg of ClearerThinking, I think I’m finally starting to make progress in explaining what’s going on. Problem #1: The Biggest SAT → IQ Conversion Site Is Wrong Thanks to Sebastian Jensen for pointing this out! He writes: A search of ‘SAT to IQ’ on google results in being presented with the website ‘iqcomparisonsite.com’. This man has directly converted the SAT percentiles to IQ scores, which is not what should be done. Tests like the ACT and SAT correlate with IQ at about 0.8-0.85 [rca], [my analysis], [emil article], [scholarly article]. The general factor of academic achievement and IQ correlate at about 0.81-0.88 [psychometric test], [GCSE grades]. This discrepancy occurs because they measure different abilities - an IQ test will test many different abilities, while the SAT/ACT only tests verbal/mathematical ability. In addition, these percentiles are very outdated as the average SAT score has changed over time due to changes in the content of the test. Instead, the ideal way to do this is to take the percentiles from the current versions of the SAT and then convert those into z-scores and then regress those z-scores by the mean by the estimated regression coefficient. Using Sebastian’s updated tables, we find that the average Less Wrong IQ as predicted by SATs goes down from 140 → 132, and the ClearerThinking IQ goes down from 134 → 124. So people probably exaggerated their IQs somewhat, and unrelatedly we were using an SAT → IQ conversion that exaggerated IQs, and so the numbers falsely appeared to match. Okay! It’s a start! Interlude: The ClearerThinking IQ Test The ClearerThinking survey included a battery of cognitive tests of exactly the sort that could usually be used to determine IQ. Unfortunately none of them were normed, so we know how all the 3700 subjects did relative to each other, but not where the 100 point is. Spencer was able to norm them to the general population based on education level. That is, he asked his sample about their educational attainment (college degree, PhD, etc) and found they were a little more educated than the US average. Since the US average IQ is 100, his sample should have an average a little higher than this. He was able to calculate how much higher. Then he mapped a bell curve to everyone in his sample’s performance on his tests. Since he had 3700 people, he was able to do this relatively smoothly. He found an average IQ of 110, which originally surprised me, because I thought his sample was supposed to be random crowdworkers, who should be close to the US average of 100. But in fact, his survey was a combination of 1900 crowdworkers and 1800 people who saw it on social media - eg friends and friends-of-friends of Spencer. Separating this out by group, we find that the crowdworkers have an average normed-IQ of 100, and the social media referrals have an average normed-IQ of 120, making the overall average of 110. This seems pretty trustworthy, since it correctly estimates the crowdworkers (completely average) as 100. Spencer studied math at Columbia, his friends and friends-of-friends are pretty smart, and I think the 120 estimate for them is also okay. But there’s still a problem here. Using an accurate SAT score → IQ calculator, we determined that the ClearerThinking average should be 124. But using real cognitive tests, it looks like it’s 110. What went wrong? Problem #2: Only The Smartest People Report Their SATs Using Spencer’s cognitive test results, we can compare people who did vs. didn’t take the SAT. We find: People who didn’t take the SAT (remember, this includes current high schoolers) have tested-IQ 110.