A Concise Critique of the Methods Used in the Personality Genetics Paper
Neuroscience

A Concise Critique of the Methods Used in the Personality Genetics Paper


The previous post, Bad News for the Genetics of Personality, discussed a genome-wide association study that searched for common genetic variants associated with personality ratings from Cloninger's temperament scales. None were found:
Participants' scores on Harm Avoidance, Novelty Seeking, Reward Dependence, and Persistence were tested for association with 1,252,387 genetic markers. We also performed gene-based association tests and biological pathway analyses. No genetic variants that significantly contribute to personality variation were identified, while our sample provides over 90% power to detect variants that explain only 1% of the trait variance. This indicates that individual common genetic variants of this size or greater do not contribute to personality trait variation, which has important implications regarding the genetic architecture of personality and the evolutionary mechanisms by which heritable variation is maintained.
The post discussed possible problems with the Tridimensional Personality Questionnaire but remained agnostic on the GWA aspects of the paper:
[Those technical and statistical methods are beyond the scope of this blog, so I will leave it to someone else to describe and critique the genotyping aspects of the paper.]
A comment at Gene Expression on Heritability, personality, and genomics by Princeton Professor Lee M. Silver criticized the methods used by Verweij et al. (2010):
20. LeeMSilver Says:
August 10th, 2010 at 8:04 am

If you read the original article describing the research, you’ll find numerous serious problems with the way the study was conducted. The GWAS approach is designed to work with a sample of unrelated individuals. But the sample set used by Wray and colleagues consisted of 5117 subjects, who only came from 2567 families. The sample set also included 1702 monozygotic twins (797 pairs), and it also included an entire cohort of people diagnosed with bipolar disorder. All of this substructure can muddy the waters, which seems to be perfectly fine to Wray and colleagues whose language gives away their bias against GWAS.

However, the really fundamental problem is the subjective complexity of all the traditional scales for measuring personality. For thousands of years, breeders tried to find patterns in heredity, with no success. Mendel succeeded not by stuffing multiple measurements into individual traits but by eliminating all the variables except one or two in each experiment. This won’t get you the genes for “harm avoidance” (which has no objective meaning) but it could uncover loci that influence the response to one important question in the harm avoidance panel, before investigating the next.


ADDENDUM: Authors Karin Verweij and Brendan Zietsch have replied to Lee Silver in the comments. Briefly, they pointed out that their analysis did take into account relatedness between family members, including monozygotic twins. They also noted that the small subsample with high vs. low depression scores was treated appropriately in the analysis. Furthermore, these high depression individuals were not diagnosed with bipolar disorder.

Besides his critique that the population was not suitable for GWAS, Professor Silver also raised a good point on reducing traits or temperaments to their constituent elements. For starters, Harm Avoidance has four subscales:
  1. Anticipatory worry (HA1)
  2. Fear of uncertainty (HA2)
  3. Shyness/Shyness with strangers (HA3)
  4. Fatigability/Fatigability and asthenia (HA4)
The same is true for Novelty Seeking, except the subscales seem even more diverse:
  1. Exploratory excitability (NS1)
  2. Impulsiveness (NS2)
  3. Extravagance (NS3)
  4. Disorderliness (NS4)
LMK made similar points in a comment on The Neurocritic's previous post. There are a number of other interesting observations, including a link to Kevin Mitchell on Nature, Nurture, and Noise. And we also have Genomes Unzipped Setting the record straight on Genetic Heterogeneity of Human Disease. So head over there and keep the conversation going. As for me, I'm still 8 comments behind...

Reference

Verweij KJ, Zietsch BP, Medland SE, Gordon SD, Benyamin B, Nyholt DR, McEvoy BP, Sullivan PF, Heath AC, Madden PA, Henders AK, Montgomery GW, Martin NG, Wray NR. (2010). A genome-wide association study of Cloninger's Temperament scales: Implications for the evolutionary genetics of personality. Biol Psychol. Aug 3. [Epub ahead of print].




- Do Men Have More Varied Personalities Than Women?
A huge study involving over 12,000 participants across 51 cultures from Argentina to Uganda has concluded that men tend to have more varied personalities than women. Peter Borkenau, his co-authors and a small army of international research assistants...

- Robert Plomin: Nature, Nurture
After forty years doing research on nature and nurture in psychology, there are two crucial (not just nagging) things I want to understand. One is about nature and one is about nurture. About nature: Behavioural genetic research has shown that genetics...

- The Influence Of Genes On Exceptional Mental Ability
We know a great deal about the relative genetic and environmental influences on average intelligence and on learning disabilities, but far less about the role of genes in exceptional cognitive ability – in lay terms, what we might call genius or innate...

- Investigating The Role Of Genes In Boys' And Girls' Science Ability
Former Harvard president Larry Summers caused a storm in 2005 when he suggested part of the reason women are under-represented in science is because of innate, biological differences between the sexes. Now, for the first time, researchers in London have...

- Six
Today was the sixth anniversary of this blog. I'm not much for meta-blogging or general chattiness, but I thought I would highlight the nine posts (out of 700) with the most comments. Thank you for your support over the years, and keep the comments...



Neuroscience








.