1. Frederick’s 3-Item Test: The Brevity of Cognitive Humiliation

In 2005, MIT Sloan School of Management professor Shane Frederick published a modest three-question psychometric assessment that shocked cognitive psychology: the Cognitive Reflection Test (CRT). Taking under three minutes to administer, this three-item questionnaire demonstrated predictive correlations with temporal discounting, heuristic bias resistance, and rational decision-making that rivaled standard multi-hour IQ batteries.

The classic CRT problems:

1. A bat and a ball cost $1.10 in total. The bat costs $1.00 more than the ball. How much does the ball cost?
2. If it takes 5 machines 5 minutes to make 5 widgets, how long would it take 100 machines to make 100 widgets?
3. In a lake, there is a patch of lily pads. Every day, the patch doubles in size. If it takes 48 days for the patch to cover the entire lake, how long would it take for the patch to cover half of the lake?

When tested across prestigious elite universities (including MIT, Harvard, and Princeton), an astonishing percentage of students failed to achieve a perfect score. Over 50% answered the bat-and-ball problem with “10 cents”—an immediate, intuitive, and mathematically catastrophic error.

2. Dual-Process Theory: System 1 Heuristic Seeding vs System 2 Verification

The brilliance of the CRT lies in its psychological architecture. Each question is specifically engineered to generate a compelling, intuitive, yet erroneous answer.

As articulated in Daniel Kahneman and Amos Tversky’s Nobel Prize-winning Dual-Process Theory:

• System 1 (Autonomous Heuristic Engine): Operates automatically, effortlessly, and instantaneously, utilizing associative pattern matching to produce a snap response. For the bat-and-ball, it splits $1.10 into $1.00 and 10¢.
• System 2 (Deliberative Algorithmic Engine): Capable of logic, formal deduction, and algebraic auditing, but inherently indolent (“lazy”). Unless actively recruited, System 2 merely ratifies the effortless proposal of System 1 without executing basic verification checks.

The CRT does not measure whether an individual possesses the algebraic capacity to solve $x + (x + 1.00) = 1.10$ ($2x = 0.10 \implies x = 0.05$). Every high school student can solve that equation. Rather, the CRT measures cognitive reflection: the meta-attentional disposition to suppress the impulsive System 1 output long enough for System 2 to verify its accuracy.

3. Comparative Matrix: CRT Item Breakdown and Analytical Logic

4. The Rationality vs Intelligence Dichotomy: Stanovich’s Dysrationalia

Why does high raw intelligence fail to insulate against CRT traps? Cognitive scientist Keith Stanovich coined the term Dysrationalia to describe the profound dissociation between IQ and rationality.

Stanovich distinguishes between the algorithmic mind (raw computational horsepower, working memory bandwidth, fluid reasoning measured by IQ tests) and the reflective mind (epistemic dispositions, intellectual humility, and the propensity to audit beliefs). An individual may possess an astronomical IQ of 145, yet behave as a “cognitive miser”—relying blindly on System 1 heuristics in daily life because their reflective mind never engages.

5. Protocols to Cultivate Reflective Rigor

To inoculate your decision-making against heuristic traps:

• The Universal Sanity Check: Whenever a solution feels instantaneous and frictionless, impose an obligate 5-second hold. Frictionless certainty is the signature hallmark of System 1 heuristic seeding.
• Active Substitution Testing: Plug your calculated output back into the original problem constraints. For the bat-and-ball: “If the ball is 10¢ and the bat is $1.00 more, the bat costs $1.10. Total = $1.20. Error detected.” The sanity check takes 3 seconds and catches 100% of failures.
• Reverse Temporal Stepping: On exponential growth and scheduling puzzles, invert the problem vector. Trace backward from the final state rather than forward from the genesis.

6. Key Analytical Takeaways

• The Cognitive Reflection Test measures inhibitory cognitive disposition rather than raw computational capability.
• System 1 generates intuitive, seductive lures that a “lazy” System 2 readily rubber-stamps without algebraic verification.
• High IQ does not guarantee rationality; cognitive reflection is an independent psychometric trait that must be deliberately cultivated.

7. Academic References

1. Frederick, S. (2005). Cognitive reflection and decision making. Journal of Economic Perspectives, 19(4), 25–42.
2. Kahneman, D. (2011). Thinking, Fast and Slow. Farrar, Straus and Giroux.
3. Stanovich, K. E. (2009). What Intelligence Tests Miss: The Psychology of Rational Thought. Yale University Press.