The Diversity Problem in Face Research
A comprehensive database of images for face research may help address the issue.
Posted August 4, 2021 | Reviewed by Chloe Williams
- Databases of face images used for research predominantly depict people from Western, educated, industrialized, rich, and democratic societies.
- A novel tool connects researchers to face image databases that best suit their research question and helps them select diverse databases.
- A database of facial images with physical anomalies also allows researchers to investigate social penalties of looking different.
This post was co-authored by Clifford I. Workman, Ph.D.
Psychology and allied disciplines, like social and cognitive neuroscience, have problems with WEIRD-ness—that is, they rely too heavily on participants from Western, Educated, Industrialized, Rich, and Democratic societies.
Joseph Henrich exposed the pervasiveness of this problem in 2010, arguing that “scientists now face a choice – they can either acknowledge that their findings in many domains cannot generalize beyond [WEIRD subpopulations] (and leave it at that), or they can begin to take the difficult steps to build a broader, richer, and better-grounded understanding of our species.”
The problems with WEIRD-ness can begin in the laboratory, long before researchers seek out the first volunteers for their studies. This problem is especially true for face research, whether focused on describing the mechanisms enabling face perception, underpinning judgments of attractiveness, extracting socially relevant information from facial cues, or even on devising machine learning algorithms to create and detect faces.
Face researchers often require photographs of faces to use as stimuli in their experiments or to train and test machine learning algorithms. Fortunately, plenty of freely available face databases for researchers are available from which to choose. Unfortunately, many of the best-known databases depict people whose demographics skew WEIRD. The FACES database, for instance—which has been cited more than 800 times according to Google Scholar—comprises only white faces (Ebner et al., 2010). For the sake of comparison, the “Multi-Racial Mega-Resolution” (MR2) face database, which is comprised of European as well as African and East Asian faces, has fewer than 80 citations (Strohminger et al., 2016).
An overabundance of face databases featuring mostly (and sometimes exclusively) white faces (e.g., DeBruine & Jones, 2017; Ebner et al., 2010; Lundqvist et al., 1998) means that relying on word of mouth and even on the literature to find such databases may lead researchers to settle for WEIRD face images despite the availability of more diverse alternatives like the MR2. Similar concerns have been raised about the age makeup of available databases, with many including only images of young faces (e.g., Chelnokova et al., 2014; DeBruine & Jones, 2017b, 2017a; Langner et al., 2010). If we are to take the “difficult steps to build a broader, richer, and better-grounded understanding of our species,” as Henrich urged, a crucial first step is for face researchers to choose faces that are diverse in terms of racial/ethnic background and age.
Connecting Researchers to Diverse Face Databases
In a recent paper published in Methods in Psychology, we describe a novel tool for connecting face researchers to the image databases best suited to their research: the “Face Image Meta-Database,” or “fIMDb” for short (Workman & Chatterjee, 2021). The fIMDb is a “meta-database” that indexes known face databases, their characteristics, and how to access them. The fIMDb enables users to build custom searches that, importantly, can be used to filter out stimulus sets with limited diversity. The fIMDb also allows user submissions of new databases and revisions to existing databases. To date, the fIMDb links to 127 different sources for faces that together contain over 4 million images.
Race and ethnicity and age aren’t the only factors that are poorly represented in most face databases. Up to now, there haven’t been any face databases available to research (of which we are aware) that include faces with visible differences like scars, port wine stains, and other craniofacial anomalies. This inclusion is important because people with facial anomalies are, according to our research, subject to an “anomalous-is-bad” bias that is linked to neural activity in a brain region called the amygdala linked to affective learning, prosocial behavior, and psychological tendencies related to empathy and beliefs about justice (e.g., that people get what they deserve; Workman et al., 2021). We built a tool called the ChatLab Facial Anomaly Database (CFAD) to fill this gap (Workman & Chatterjee, 2021). The CFAD contains 4,351 images of 163 people with visible facial anomalies before and, whenever available, after surgical intervention to limit the visual salience of any anomalies (Jamrozik et al., 2019 & Workman et al., 2021).
In publishing the CFAD alongside the fIMDb, we hope that people who research the psychology and neurobiology of face processing might be inspired by the availability of the CFAD to advance our understanding of the social penalties of looking different. We hope that, together, the fIMDb and CFAD help face researchers to make their research a little less WEIRD.
Chelnokova, O., Laeng, B., Eikemo, M., Riegels, J., Løseth, G., Maurud, H., Willoch, F., & Leknes, S. (2014). Rewards of beauty: the opioid system mediates social motivation in humans. Molecular Psychiatry, 19(7), 746–747. https://doi.org/10.1038/mp.2014.1
DeBruine, L., & Jones, B. (2017a). Face Research Lab London Set. FigShare. https://doi.org/10.6084/m9.figshare.5047666.v5
DeBruine, L., & Jones, B. (2017b). Young Adult White Faces with Manipulated Versions. FigShare. https://doi.org/10.6084/m9.figshare.4220517.v1
Ebner, N. C., Riediger, M., & Lindenberger, U. (2010). FACES—A database of facial expressions in young, middle-aged, and older women and men: Development and validation. Behavior Research Methods, 42(1), 351–362. https://doi.org/10.3758/BRM.42.1.351
Henrich, J., Heine, S. J., & Norenzayan, A. (2010). The weirdest people in the world? Behavioral and Brain Sciences, 33(2–3), 61–83. https://doi.org/10.1017/S0140525X0999152X
Jamrozik, A., Oraa Ali, M., Sarwer, D. B., & Chatterjee, A. (2019). More than skin deep: Judgments of individuals with facial disfigurement. Psychology of Aesthetics, Creativity, and the Arts, 13(1), 117–129. https://doi.org/10.1037/aca0000147
Langner, O., Dotsch, R., Bijlstra, G., Wigboldus, D. H. J., Hawk, S. T., & van Knippenberg, A. (2010). Presentation and validation of the Radboud Faces Database. Cognition & Emotion, 24(8), 1377–1388. https://doi.org/10.1080/02699930903485076
Lundqvist, D., Flykt, A., & Öhman, A. (1998). The Karolinska Directed Emotional Faces - KDEF. Department of Clinical Neuroscience, Psychology Section, Karolinska Institutet. https://www.kdef.se/
Strohminger, N., Gray, K., Chituc, V., Heffner, J., Schein, C., & Heagins, T. B. (2016). The MR2: A multi-racial, mega-resolution database of facial stimuli. Behavior Research Methods, 48(3), 1197–1204. https://doi.org/10.3758/s13428-015-0641-9
Workman, C. I., & Chatterjee, A. (2021). The Face Image Meta-Database (fIMDb) & ChatLab Facial Anomaly Database (CFAD): Tools for research on face perception and social stigma. PsyArXiv Preprints, 1–22. https://doi.org/10.31234/osf.io/54utr
Workman, C. I., Humphries, S., Hartung, F., Aguirre, G. K., Kable, J. W., & Chatterjee, A. (2021). Morality is in the eye of the beholder: the neurocognitive basis of the “anomalous‐is‐bad” stereotype. Annals of the New York Academy of Sciences, 1494(1), 3–17. https://doi.org/10.1111/nyas.14575
ChatLab Facial Anomaly Database (CFAD): https://clffwrkmn.net/cfad/