Beyond Words

The science and fun of nonverbal communication

Embodied Cognition: What It Is & Why It's Important

Learn what embodied cognition is and why it is important.

I recently conducted the following interview with Dr. Andrew Wilson and Dr. Sabrina Golonka in regards to embodied cognition. Together, they write the popular blog PyschScienceNotes [here] as well as tweeting as @PsychScientist. Given their willingness to often blog and tweet on this topic, I reached out to them to offer everyone some basics on what embodied cognition is, what it is not, and why it is important—to everyone. Enjoy!

Embodied cognition is the latest sexy topic in cognitive science. There is, however, a great deal of confusion about exactly what it means and how to study it. A lot of studies have hit the headlines claiming to be examples of embodiment, but if you look a little deeper they are really just business as usual with a few bells and whistles. The view of embodiment we would like to defend is a fairly radical view, with far-ranging implications for how we do cognitive science and what we will end up thinking the brain (for example) is up to.

Find a Therapist

Search for a mental health professional near you.

 

What embodied cognition is not

Traditional theories in psychology place all the responsibility for generating our behaviour in the brain; perception is the input to a computational, representational system that mentally transforms the input into motor commands. Many researchers treat embodied cognition as the idea that the contents of these mental states/representations can be influenced by the states of our bodies.

For example, Eerland, Guadalupe & Zwann (2011) recently suggested that leaning to the left makes you underestimate the magnitude of things, because this state of the body biases you towards the left hand end of the mental number line they claim we use to generate estimates of magnitude (more here). You can also demonstrate the connection between 'mind' and 'body' goes the other way; Miles, Lind & Macrae (2010) showed that thinking about the future made you sway forwards and thinking about the past made you sway backwards; they suggest this sway is caused by the underlying metaphor of 'past is behind us' and 'the future is ahead of us' (more here).

There are numerous problems with these studies; the primary problem, however, is that in both cases the mental content is assumed to the same as it would be if you were doing non-embodied cognition. This research remains business as usual, with a couple of embodied bells and whistles—all the hard work of generating behaviour is done in the brain, it's just that this work can be biased by what the body is up to. However, the hypothesis that the body can play a role in cognition is actually much more radical than this. By expanding the resources available to solve a task from simply the brain to include the body (with its perceptual and motor systems), we've opened up the possibility that we can solve a task in a very different way than a brain by itself might solve the task.

 

What embodied cognition is

The kind of embodied cognition we advocate (more here) is the claim that the brain, while important, is not the only resource we have available to us to generate behaviour. Instead, the form of our behaviour emerges from the real-time interaction between a nervous system in a body with particular capabilities and an environment that offers opportunities for behaviour and information about those opportunities. The reason this is quite a radical claim is that it changes the job description for the brain; instead of having to represent knowledge about the world and using that knowledge to simply output commands, the brain is now a part of a broader system that critically involves perception and action as well. The actual solution an organism comes up with for a given task includes all these elements.

A baseball explains embodied cognition?

Our favourite example of this right now is 'the outfielder problem' (more here). This is the question of how a baseball outfielder can catch a fly ball—how do they manage to get to the right place at the right time? The disembodied, computational solution notes that in order to predict where the ball will land, you need a model of the projectile motion of the ball and some information about its initial conditions as it came off the bat (speed, direction, etc). Perception provides this input, the brain uses a representation that implements the model to predict the landing location and then commands the body to move the right location.

The embodied solution instead begins with a task analysis; what resources are available to a mobile, perceiving-acting organism to solve the task? Do we need to compute anything, or can we simply directly use perceptual information to guide our interception? It turns out that careful consideration of the task reveals two potential informational strategies that are consequences of the parabolic arc the fly ball takes through the air.

The first works if you are in a direct line with the arc of the fly ball; if you run so as to make the (actually accelerating) ball appear to move at constant velocity, it turns out you will end up in the right place at the right time. If you are off the direct line, you can move so as to make the (actually curved) trajectory of the ball appear linear. There is no prediction or internal model required; instead, the outfielder solves the prediction problem by moving in a particular way.

Evidence strongly supports this latter prospective control strategy—people move in the kinds of curved paths it predicts (McBeath, Shaffer & Kaiser, 1995), as do dogs (Shaffer, Krauchnas, Eddy & McBeath, 2004). In effect, the work done by a computation in the disembodied account is instead done by the way you move in the embodied account; embodiment does work to solve problems that was typically assumed to be all done in the head.

Our other favourite way to describe the difference between the traditional, non-embodied computational approach and embodied cognition is to point to two very different kinds of robots (more here). Robots have an advantage in that we know exactly what went into making them—we know if they are computing sophisticated solutions, or simply moving under the control of simple rules. We can then look to see what their behaviour is like and relate that to biological organisms like ourselves.

Honda's ASIMO literally implements a traditional cognitive, computational approach. Everything it does is the output of complex internal programmes which control everything he does. Honda are fond of trotting him out to dance, run, and climb stairs; he can do all this, but it's very fragile. Minor disruptions throw him entirely (e.g. a minor error in foot placement and he falls (http://www.youtube.com/watch?v=ASoCJTYgYB0); hide his pre-set landmarks with a little clutter and he completely fails to navigate his way across a room). He's slow, and inefficient; if you knock him, he needs time to recompute his behaviour or else he falls, and he often doesn't have the time.

The 'BigDog.' Picture from nextbigfuture.com

Contrast this to Boston Dynamics Big Dog. They wanted a robot that could walk over rough, uncertain terrain while carrying heavy loads, and they knew that the computational strategy was too slow and cumbersome. So they instead built a robot with springy legs and joints that mimic the kind of dynamical systems seen in animal quadrupeds. Big Dog has very little brain; the specific movements he produces at any given time emerge from the interaction between his moving legs, the surface he's on and any other forces acting on him. If you knock Big Dog, he doesn't need to recompute his behaviour; he simply responds to the new force and the details are left up to his anatomy (his leg moves where it goes because that's the way it's built; http://www.youtube.com/watch?v=cNZPRsrwumQ). He looks very biological when he does it, too.

 

Why is embodied cognition important for people who rely on communication?

The fascinating insight of embodied cognition is that behaviour is not simply the output of someone's isolated brain. Communication is an interesting example; how well a given person's conversational style works depends on the environment in which they find themselves. If you're interested in changing someone's communication behaviour, the implication is that you don't necessarily need to change anything about them; you might instead focus on changing the environment. In addition, embodiment done right gives you a way to talk rigorously about conversations as events spread across two (or more) people; it's not two distinct people each adding their piece to the conversation, but a negotiation extended over time and relying on a flow of information that each person is helping to shape.

 

Further suggested reading

There are a lot of books on embodied cognition but of course this is partly because there are so many different flavours. There are a few recent works that get embodiment right, though. They all review recent empirical work that support this view of embodied cognition.

 

Louise Barrett, Beyond the Brain: How Body and Environment Shape Animal and Human Minds (2011)

This book is an excellent review of all the key pieces to embodied cognition, including James J Gibson's ecological approach to perception and action, dynamical systems theory and summaries of some key empirical research such as work by Esther Thelen and Linda Smith on the A-not-B error and a fascinating chapter on how the Portia spider uses embodied action to hunt other spiders using mimicry and deception, as well as some robot crickets that contain only very simple body parts but produce all kinds of adaptive complex behaviour. Highly readable and accessible to a general audience.

 

Rolf Pfeifer & Josh C Bongard, How The Body Shapes the Way We Think: A New View of Intelligence (2012).

Pfeifer makes robots that have very simple internal control systems but interesting perceptual and action capabilities. He's demonstrated numerous examples of how the kind of body you give a robot can alter how it behaves, without ever changing the internal states. Robot studies are, as we noted, excellent ways to demonstrate that a behaviour is emerging from simple embodied solutions rather than sophisticated internal models because you can build a robot without the latter and still have it produce the behaviour.

(There's also a recent pre-print in arXiv.org of a paper by Pfeifer that reviews animal and robotic case studies demonstrating various aspects of embodiment; http://arxiv.org/abs/1202.0440)

Antony Chemero, Radical Embodied Cognitive Science (2009).

Chemero is a philosopher of science who follows the implications of embodied cognition to deny that the brain trades in mental representations. He also relies heavily on Gibson and dynamical systems theory. This is a slightly more specialised book, but provides a lot of useful specifics about what an embodied cognitive science research programme should look like.

Dr Andrew D Wilson is a Lecturer in Motor Control at the University of Leeds. His research is on the embodied, perceptual control of action with a particular interest in learning, and how these change across the lifespan. 

Dr Sabrina Golonka is a Lecturer in Psychology at Leeds Metropolitan University. Her research takes an ecological and embodied approach to language and categorization.

Sabrina & Andrew blog at http://psychsciencenotes.blogspot.com and you can follow them on Twitter, @PsychScientists (https://twitter.com/#!/PsychScientists)

 

Jeff Thompson is a Ph.D. candidate researching nonverbal communication and mediation at Griffith University Law School.

more...

Subscribe to Beyond Words

Current Issue

Dreams of Glory

Daydreaming: How the best ideas emerge from the ether.