Bias: What Is It? And When Is It Bad?
Some biases are uncontroversially bad, while others are mundane or beneficial.
Posted April 17, 2021 | Reviewed by Abigail Fagan
Bias is a hot topic. Many people have expressed concern about bias in admissions, hiring, policing, sentencing, social media moderation, and many other aspects of society. The worry is that biases like these are wrong and detrimental.
Upon reflection, however, not all biases are bad. Further, some biases may be good. So bias is not always cause for concern. If that is surprising, then you may want to know what I mean by "bias." This post will briefly describe what bias means in cognitive science and various ways to evaluate whether a bias is bad.
1. What Do I Mean By Bias?
Many of us tend to buy from some products rather than their alternatives: MacOS vs. Windows, Starbucks vs. Dunkin, eBay vs. Amazon, etc. Cognitive scientists often refer to such measurable tendencies as biases (Evans, 1989).
We can measure biases in many ways. For example, we can measure the frequency with which I choose one brand over another. Or we can measure the time it takes me to determine whether I like one brand vs. its competitors. For example, if I tend to buy Apple products more than their competitors' products and be faster to decide that I like an Apple product than a similar product from another company, then I seem to exhibit a measurable bias in favor of Apple products (over their alternatives).
Of course, frequency and timing are not the only measurable forms of bias. There are many more (Hammersley & Gomm, 1997; Petty et al., 1997; Stanovich, Toplak, & West, 2008).
2. Is Bias Always Bad?
Discrimination on the basis of race, sex, and other social categories is widely considered bad. The point of this post is not to dispute the badness of such biases. However, many biases are probably not considered so problematic. For example, you may not care if we tend to pronounce or comprehend certain syllables faster than others. These phonetic biases seem neither malicious nor harmful.
Moreover, some biases may be good. For instance, you probably believe that logically valid arguments are better than fallacious arguments. You may also believe that we should discriminate between causal evidence and merely correlational evidence. These seem like obviously reasonable biases, but even seemingly irrational biases may have benefits (Bortolotti, 2020; Gigerenzer & Brighton, 2009; Johnson, Blumstein, Fowler, and Haselton, 2013).
There are a few implications of such unproblematic or even beneficial biases. One implication is the bias fallacy (Byrd, 2017): inferring that something is wrong or bad solely because of a bias that it exhibits.
3. What Makes A Bad Bias Bad?
If we cannot infer badness or wrongness from the mere existence of a bias, then how do we determine whether biases (or the decisions they cause) are bad? There may not be a universal rule to determine the badness of all biases. So we may need to evaluate each instance of bias on a case-by-case basis. And evaluation can be even more complicated: there is more than one way to evaluate biases.
Consequentialists evaluate biases according to their outcome—e.g., whether they produce unjust inequalities or increase the overall amount of harm. Deontologists evaluate biases by their intrinsic features—e.g., whether they involve harmful intent or constitute unacceptable behavior. Pluralists may embrace both forms of evaluation (as well as others).
So evaluating biases on our own is a challenge but evaluating biases together may be even more difficult. After all, if you and I have a reasonable disagreement about how to properly evaluate a bias, then we may arrive at a stalemate about whether a particular bias is bad (Elqayam & Evans, 2011; Thompson, 2011).
4. Why Does Bias Matter?
Many people get nervous or defensive as soon as I mention that I study bias (e.g., Byrd, 2019). They seem to assume that 'bias' refers to some kind of pernicious prejudice. A bit of reflection reveals that although this is sometimes correct, there seem to be exceptions—and the hard work of determining which cases are exceptional can be illuminating (Evans & Stanovich, 2013). So, when discussing the cognitive science of bias, we may find the need to highlight these exceptions and their implications. One way to do that is to refer to this post.
Bortolotti, L. (2020). The Epistemic Innocence of Irrational Beliefs. Oxford University Press.
Byrd, N. (2017, March 12). The Bias Fallacy https://byrdnick.com/archives/11072/the-bias-fallacy
Byrd, N. (2019). What we can (and can’t) infer about implicit bias from debiasing experiments. Synthese, 198(2), 1427–1455. https://doi.org/10.1007/s11229-019-02128-6
Elqayam, S., & Evans, J. S. B. T. (2011). Subtracting “ought” from “is”: Descriptivism versus normativism in the study of human thinking. Behavioral and Brain Sciences, 34(5), 233–248. https://doi.org/10.1017/S0140525X1100001X
Evans, J. (1989). Bias in human reasoning: Causes and consequences (Vol. ix). Lawrence Erlbaum Associates, Inc.
Evans, J., & Stanovich, K. E. (2013). Dual-Process Theories of Higher Cognition Advancing the Debate. Perspectives on Psychological Science, 8(3), 223–241. https://doi.org/10.1177/1745691612460685
Gigerenzer, G., & Brighton, H. (2009). Homo Heuristicus: Why Biased Minds Make Better Inferences. Topics in Cognitive Science, 107–143. https://doi.org/10.1111/j.1756-8765.2008.01006.x
Hammersley, M., & Gomm, R. (1997). Bias in Social Research. Sociological Research Online, 2(1), 7–19. https://doi.org/10.5153/sro.55
Johnson, D. D. P., Blumstein, D. T., Fowler, J. H., & Haselton, M. G. (2013). The evolution of error: Error management, cognitive constraints, and adaptive decision-making biases. Trends in Ecology & Evolution, 28(8), 474–481. https://doi.org/10.1016/j.tree.2013.05.014
Petty, R. E., Wegener, D. T., & Fabrigar, L. R. (1997). Attitudes and attitude change. Annual Review of Psychology, 48, 609–647. https://doi.org/10.1146/annurev.psych.48.1.609
Polonioli, A., Stammers, S., & Bortolotti, L. (2018). “Good” biases: Does doxastic irrationality benefit individuals and groups? Revue Philosophique de La France et de Letranger, Volume 143(3), 327–344. https://www.cairn-int.info/abstract-E_RPHI_183_0327--good-biases-does-d…
Stanovich, K. E., Toplak, M. E., & West, R. F. (2008). The development of rational thought: A taxonomy of heuristics and biases. Advances in Child Development and Behavior, 36, 251–285. https://doi.org/10.1016/S0065-2407(08)00006-2
Thompson, V. A. (2011). Normativism versus mechanism. Behavioral and Brain Sciences, 34(5), 272–273. http://dx.doi.org/10.1017/S0140525X11000574