How intelligent are intelligence tests?: Whitehead responds
Posted by gregdowney on December 21, 2008
Dear readers. Dr. Charles Whitehead wrote a long and thoughtful response to my earlier post on the Flynn Effect, but I worried that comments may not get read as often (or carefully) as the main posts, so I’m taking the liberty of giving Dr. Whitehead his own post. For more about Charles Whitehead’s work and his online activities, see Charles Whitehead: Social Mirrors here at Neuroanthropology.
From an anthropological point of view cognitive scientists are being less than rational when they treat intelligence scales as though they are measuring something fundamental and innate in human beings. No doubt innate abilities are used by people when they tackle IQ tests, but it is unlikely that such abilities evolved under selection pressure for this kind of problem solving.
Intelligence scales are culturally embedded artifacts designed to meet the idiosyncratic needs of postindustrial western societies, and reflect the equally idiosyncratic assumptions found in the west – such as our habit of referring to someone as “brainy” when we mean “intelligent”, and the widely held assumption that brains got bigger during human evolution because of selection pressure for “intelligence” (and/or language: e.g. Deacon 1992). The idea that human intelligence is the ultimate pinnacle of biological evolution may be little more than colonialist propaganda, suggesting that “scientific” societies are the ultimate pinnacle of cultural evolution – and hence morally entitled to dominate others who formerly managed perfectly well without the blessings of “modernity”.
Sir Francis Galton devised the first intelligence test in the late 19th century and this was followed by the scale developed by Alfred Binet and Théophile Simon between 1905 and 1911 (Atkinson et al., 1993: 457-8). As early as 1884 Galton examined more than 9,000 visitors to the London exhibition and found to his chagrin that eminent British scientists could not be distinguished from ordinary citizens on the basis of head size (ibid: 458). From that point on the kind of assumptions made by Galton have continued to pervade scientific thinking with little or no empirical encouragement.
A curious more recent example is the spate of papers attempting to correlate brain size with “intelligence” as assessed by (notably) the Wechsler Adult Intelligence Scale (Andreason et al., 1993 ; Egan et al., 1994, 1995; Peters, 1995; Flashman et al., 1998; Rushton & Ankney, 1995, 1996, 2000; Vernon et al., 2000; Thompson et al., 2001; MacLullich et al., 2002; Staff, 2002; Drachman, 2002). Some of this research has provoked controversy over issues of anthropological concern, including ethnocentrism, sexism, and racism (Peters, 1995; Rushton & Ankney, 1995, 1996). Researchers did indeed find a positive correlation and this has been acclaimed as a vindication of the studies and the underlying ideology of “big-brained people are smarter” (McDaniel, 2005). In point of fact, a meta-analysis of 37 studies, involving 1,530 people, yielded a best estimate for the population correlation (r) of 0.33 (McDaniel, 2005), suggesting that the intelligence factors measured are associated with around 11% (r2) of brain volume, and cannot account for the bulk of brain expansion during the last 2.5 million years.
Why the scientists concerned should feel they have achieved something useful becomes all the more mysterious when you realize that many components of the scales used assess culturally acquired skills which were invented in historic times – particularly numeracy and written language (other questions address institutionalized factors such as money and banking, and none can be claimed with confidence to be free from cultural conditioning). Many preliterate societies even today lack numbers higher than two, and others no higher than five. Numeracy and literacy originated with the bureaucratic needs of the first civilizations along the river valleys of the Nile, Tigris, Euphrates, Indus, Ganges, and the Yellow River in China. These of course post-date the agricultural revolution (around 10,000 years ago).
An analysis of 217 fossil crania (De Miguel & Henneberg, 2001) – the largest sample we have to date – suggests that average human cranial capacity just prior to the agricultural revolution was around 1,500 cm3, which is about 12% larger than the average human capacity today (1,340 cm3). In other words, intelligence scales measure abilities that developed at a time when brains were most probably getting smaller, and any correlation between such abilities and brain size is less than informative (since it serves only to reinforce current biases in cognitive science). All these studies would seem to be a prodigal waste of research funding and resources – a waste that could easily have been avoided with a little anthropological input.
Currently the dominant theory of brain expansion in primates is the social or Machiavellian intelligence hypothesis, which holds that social intelligence makes greater cognitive demands than object intelligence. So why did all these researchers choose individualistic instruments such as the Wechsler scale (1939) rather than, say, Gardner’s (1983) measures of “six intelligences”? Gardner argued that social, musical, artistic, and “bodily-kinaesthetic” (including dance and sports) skills have been important since the “dawn of civilization” whereas logical scientific thought only came to the fore after the European Renaissance (Atkinson et al., 1993: 476). But the very term we use to define our species – Homo sapiens – presupposes an evolutionary trajectory ultimately directed towards the production of scientists.
The idea of a “general” (as opposed to social) intelligence is at best dubious. The point can be illustrated by a brain scanning study which contrasted “theory of mind” (ToM) with “non-ToM” stories and cartoons (Gallagher et al., 2000). The investigators assumed that brain structures activated by non-ToM stories and cartoons were “general reasoning” areas, and only those uniquely activated by ToM stories and cartoons were “ToM” (i.e. social reasoning) areas. They concluded that ToM involves a rather small area in ventromedial prefrontal cortex. However, the “general reasoning” areas were much more strongly activated during ToM than non-Tom tasks. It would seem more reasonable to infer that “general reasoning” involves a subset of social reasoning areas, and that “general intelligence” is a spin-off benefit of social intelligence. Animals which score most highly in laboratory studies of intelligence and language are invariably highly social – such as chimpanzees, dolphins, and Congo grey parrots.
The discovery of the Flynn effect should have alerted us by now to the culturally conditioned limitations of western intelligence scales. These tests may predict academic performance in western institutions, but they cannot provide reliable information about innate functions of the human brain. More plausible views of the social brain and human brain expansion (in my opinion, of course) can be found at http://www.socialmirrors.org. The Human Evolution page is not yet up, but relevant papers are referenced on the Social Brain page and my own papers can be downloaded from here and from my CV (see About Charles Whitehead: Publications).
Andreasen, N. C., Flaum, M., Swayze II, V., O’Leary, D. S., Alliger, R., Cohen, G., et al. (1993) ‘Intelligence and brain structure in normal individuals’, American Journal of Psychiatry, 150, 130–4.
Atkinson, R.L., Atkinson, R.C., Smith, E.E., Bem, D.J. (1993) Introduction to Psychology (Fort Worth: Harcourt Brace).
Deacon, T.W. (1992) ‘The human brain’, in Jones, S., Martin, R., Pilbeam, D., eds., The Cambridge Encyclopedia of Human Evolution (Cambridge: Cambridge University Press) pp. 115-23.
De Miguel, C. & Henneberg, M. (2001) ‘Variation in hominid brain size: How much is due to method?’, Homo, 52 (1), pp. 3-58.
Drachman, D.A. (2002) ‘Hat size, brain size, intelligence, and dementia’, Neurology, 59, 156-157.
Egan, V., Chiswick, A., Santosh, C., Naidu, K., Rimmington, J. E., & Best, J. J. K. (1994) ‘Size isn’t everything: A study of brain volume, intelligence and auditory evoked potentials’, Personality and Individual Differences, 17, 357–367.
Egan, V., Wickett, J. C., & Vernon, P. A. (1995). Brain size and intelligence: Erratum, addendum, and correction. Personality and Individual Differences, 19, 113–115.
Flashman, L. A., Andreasen, N. C., Flaum, M., & Swayze, V. W. (1998) ‘Intelligence and regional brain volumes in normal controls’, Intelligence, 25, 149–160.
Gallagher, H.L., Happé, F., Brunswick, N., Fletcher, P.C., Frith, U., Frith, C.D. (2000) `Reading the mind in cartoons and stories: an fMRI study of “theory of mind” in verbal and nonverbal tasks’, Neuropsychologia 38, 11–21.
MacLullich, A. M. J., Ferguson, K. L., Deary, I. J., Seckl, J. R., Starr, J. M., & Wardlaw, J. M. (2002), ‘Intracranial capacity and brain volumes are associated with cognition in elderly men’, Neurology, 59, 169–174.
McDaniel, M.A. (2005) ‘Big-brained people are smarter: A meta-analysis of the relationship
between in vivo brain volume and intelligence’, Intelligence, 33, 337-46.
Michael A. McDaniel
Peters, M. (1995) ‘Does brain size matter? A reply to Rushton and Ankney’, Canadian Journal of Experimental Psychology; 49 (4).
Rushton, J.P. and Ankney, C.D. (1995) ‘Brain size matters: A reply to Peters’, Canadian Journal of Experimental Psychology; 49 (4).
Rushton, J. P., & Ankney, C. D. (1996) ‘Brain size and cognitive ability: Correlations with age, sex, race, social class, and race’, Psychonomic Bulletin and Review, 3, 21–36.
Rushton, J. P., & Ankney, C. D. (2000) ‘Size matters: A review and new analyses of racial differences in cranial capacity and intelligence that refute Kamin and Omari’, Personality and Individual Differences, 29, 591–620.
Staff, 2002 Staff, R. T. (2002). Personal communication to Michael A. McDaniel on November 11, 2002.
Thompson, P. M., Cannon, T. D., Narr, K. L., Erp, T. V., Poutanen, V. -P., Huttunen, M., et al. (2001) ‘Genetic influences on brain structure’, Nature Neuroscience, 4 (12), 1253–1258.
Vernon, P. A., Wickett, J. C., Bazana, P. G., & Stelmack, R. M. (2000) ‘The neuropsychology and psychophysiology of human intelligence’, in R. J. Sternberg (Ed.), Handbook of intelligence (New York: Cambridge University Press) pp. 245-64., brain