Skip to main content

Pre-1994 SAT

This consists of a variety of previously written posts on the old SAT. It will be rewritten in a cohesive way in the future.

Is the SAT an IQ test?

The SAT after 1994 is no longer an IQ test, as College Board deliberately redesigned the test to mirror high school coursework. "Thanks to an unprecedented assault from the head of the University of California system, the College Board (the nonprofit organization that owns the SAT) has begun its biggest overhaul ever of the test"1. In early 1994, the verbal section dropped antonyms, doubled the share of passage-based reading, and the math section began allowing calculators and open-ended responses. These changes were repeated in subsequent updates to the test, diluting its saturation with the general intelligence factor (g). Due to these changes, the modern SAT moved from an aptitude test to a scholastic achievement test which can definitely be practiced for. However, this wiki will be specifically referring to the SAT forms before 1994, which have been found to be psychometrically equivalent to a Full Scale IQ test.

Directly admitted by the College Board president, Gaston Caperton, "in its original form [the SAT] was an IQ test."1 In 2004, Frey & Detterman, using a National Longitudinal Survey of Youth subsample who had taken the old SAT, found the composite score correlated r = 0.82 with g extracted from the ten subtest ASVAB, and r = 0.72 (range-restricted) with Raven's Advanced Progressive Matrices, a well known fluid reasoning test2.

SAT Validity

Fig. 1. Scatter plots of Scholastic Assessment Test (SAT) scores and IQ estimates: first-factor score (IQ scale) from the Armed Services Vocational Aptitude Battery (ASVAB) as a function of (a) SAT total score and (b) unstandardized predicted IQ based on SAT total score, SAT2, and SAT3 and (c) Raven's Advanced Progressive Matrices score (IQ scale) as a function of SAT total score2

Furthermore, as pointed out by Frey & Detterman, "it is evident from these results that there is a striking relation between SAT scores and measures of general cognitive ability. In fact, when one examines the results in [Fig. 2.], especially those in the ASVAB column, it appears that the SAT is a better indicator of g, as defined by the first factor of the ASVAB, than are some of the more traditional intelligence tests."2

SAT Validity 2

Fig. 2. Intercorrelation matrix of the SAT with other well known tests of g2

Another independent study of the SAT's value as an IQ test confirms the above findings. "In a study of 339 undergraduates, Brodnick and Ree (1995) used covariance structure modeling to examine the relationship between psychometric g, socioeconomic variables, and achievement-test scores. They found substantial general-factor loadings on both the math (.698) and the verbal (.804) SAT subtests."2 While they used the SAT itself to define their first factor as g, the evidence strongly suggests it measures the same first factor g measured by IQ tests. Another thing that should be kept in mind is that these loadings are deflated due to Spearman’s Law of Diminishing Returns (SLODR), as the sample of students who took SATs were above average, college-bound high school graduates, placing them above the average 100 IQ population.

Why was the old SAT so g-loaded? Its creator, Princeton psychologist Carl Brigham, lifted item formats directly from the World War I Army Alpha intelligence tests he developed, meaning the exam's backbone was abstract analogies, antonyms, and logic puzzles that were always intended as an IQ test (and also the exact formats which the post-1994 revisions have removed).

The common objection of the SAT being skewed by the amount of prep time invested by test takers is directly contradicted by large-scale College Board studies, which put coaching gains at ~9-15 points on verbal and ~15-18 points on math3. Furthermore, there are heavy diminishing returns to the amount of time spent, as demonstrated in Fig. 3 below.

SAT Validity 3

Fig. 3. The diminishing returns to coaching for the SAT4

The gains shown above equate to approximately between one to six IQ points- far too small to explain uncorrected correlations in the .70-.80 range with independent IQ measures. One theory as to the resistance of the SAT to the practice effect compared to other tests is its unique property of having multiple forms. Contrast that with most professionally administered IQ tests (such as the WAIS-IV or SB-V), which rely on a single copyrighted form that proctors have to guard. If a client or an internet leak reveals those items, the whole instrument is compromised until the publisher can fund and norm an alternate edition (a process which takes years). By design, the SAT's rotating forms limit any item-specific exposure that inflates retest scores on pro tests.

Few IQ tests have ever combined the accuracy of a top-tier FSIQ battery with the scale, form security, and predictive power of the pre-1994 SAT. With multiple peer reviewed independant studies reporting g correlations on par with how gold standard, professional tests correlate with each other, the old SAT can definitely stand with more conventional IQ tests. However, where the SAT is unique is, unlike pro tests given to a few thousand volunteers, the SAT was normed on millions of examinees every year and continuously equated every year. A vast, rotating item bank also meant each administration kept coaching effects trivial. Given the SAT's predictive validity with college and even mid-career outcomes in samples exceeding 200,000 students, the old SAT may be the most underappreciated intelligence test ever created.


National SAT Averages Converted to IQ (1955-1983)

YearSAT-VSAT-MV+M
195598.5103.1100.9
1960101.7102.3102.1
1966102.7100.6101.8
1974101.0101.4101.3
1983101.9102.4102.3

These are using older norms, but they still show that this test is immune to the Flynn effect.


Intended Major FieldAverage IQMean SATVMean SATMMean SATV+SATMPercent Planning Graduate Degree
Physics126558641119989
Interdis./other sci.120520589110977
Astronomy120526578110486
Economics120519576109581
International rel.119544546109082
Chemical engineering119490589107975
Chemistry118500572107278
Math & statistics117469593106265
Aerospace engineering116472555102763
Political science115507515102276
"Other" engineering115460559101965
Biological sciences114480524100481
Mechanical engin.11444254398553
Electrical engin.11343654397957
Civil engineering11343653396951
Earth & environ. sci.11245848994765
"Other" social sci.11045846792561
Arch./Environ. engin.10941949491356
General psychology10944846391178
Computer science10941348990246
Social psychology10843945189067
Child psychology10641542884372
Sociology10641442984350
Agriculture10640443684031
Law enforcement10338140878933

Norms to Convert to IQ

Composite Norms

SAT CompositeIQSAT CompositeIQ
16001661000114
1590163990114
1580161980113
1570159970113
1560157960112
1550155950112
1540154940111
1530153930110
1520152920110
1510151910109
1500150900109
1490149890108
1480148880108
1470147870107
1460146860107
1450145850106
1440144840106
1430143830105
1420142820105
1410141810104
1400140800103
1390139790103
1380139780102
1370138770101
1360138760101
1350137750100
134013774099
133013673099
132013672098
131013571097
130013470097
129013369096
128013368095
127013267095
126013166094
125013065093
124013064093
123012963092
122012862091
121012761090
120012760089
119012659088
118012558087
117012457086
116012456085
115012355084
114012254083
113012253082
112012152081
111012051080
110012050079
109011949077
108011948075
107011847073
106011746071
105011745069
104011644067
103011643065
102011542063
101011541061
40058

Subtest Norms

SubtestVerbal ScoreMath Score
800159152
790156149
780154147
770152145
760150143
750148141
740146139
730144138
720142137
710141136
700140135
690139134
680138133
670137132
660135131
650134129
640133128
630132126
620130125
610129123
600127122
590126121
580124120
570123119
560122118
550121117
540120116
530119115
520118114
510117113
500116112
490114111
480113110
470112109
460111108
450110107
440109106
430108105
420107104
410106103
400105101
390103100
38010299
37010198
36010097
3509995
3409794
3309692
3209591
3109389
3009287
2909185
2808983
2708781
2608578
2508375
2408172
2307969
2207766
2107563
2007259

Citations

Footnotes

  1. https://www.mail-archive.com/futurework@scribe.uwaterloo.ca/msg05978.html 2

  2. https://gwern.net/doc/iq/high/smpy/2004-frey.pdf 2 3 4 5

  3. https://files.eric.ed.gov/fulltext/ED562660.pdf

  4. https://onlinelibrary.wiley.com/doi/epdf/10.1002/j.2333-8504.1980.tb01209.x