Verified by 
When playing video games, do you play better with the sound on or off?
Every gamer may have an opinion—but what has research shown?
Some studies suggest that music and sound effects enhance performance. For instance, Tafalla (2007) found that male gamers scored almost twice as many points while playing the first-person shooter game DOOM with the sound on (chilling music, weaponfire, screams, and labored breathing) compared to those playing with the sound off.
On the other hand, Yamada et al. (2001) found that people had the fastest lap times in the racing game Ridge Racer V when playing with the music off. Interestingly, 10 different music tracks were tested—and the lowest scores were earned when playing with the soundtrack built into the game (Boom Boom Satellite’s "Fogbound").
Sometimes the results are more complex. Cassidy and MacDonald (2009) tested people playing a driving game with car sounds effects alone or with car sound effects plus different kinds of music. People playing with music that had been shown to be ‘highly arousing’ (in previous research) drove the fastest—but also made the greatest number of mistakes, such as hitting barriers or knocking over road cones!
In our own research (published 2010 and 2012), my colleagues John Baxa and Matt Spackman and I found that people playing Twilight Princess (Legend of Zelda) performed worst when playing with both music and sound effects off. This game provides the player with rich auditory cues that function as warnings, clues for access points, feedback for correct moves such as successful attacks on enemies, and more. Many of these don’t just “double” what you see on the screen.
As we progressively added more game audio, performance improved. However, surprisingly, our participants performed best when playing with background music playing on a boombox that was unrelated to the game! (This would be like playing a game with the game sound switched off—while your roommate’s music is playing in the background).
How to boost your game play?
So how do we make sense of these findings? And do they shed light on what distinguishes the top gamers?
A closer look at the individuals in our 2010/2012 study suggested that the majority of our participants—but not all—played better with unrelated background music until they “got the hang of” the game.
We used a game that was new to everybody. As Twilight Princess is a pretty complex adventure role-playing game, the average player seemed to have to focus attention on the visual information when first navigating the game. So music and sound effects built into the game may have interfered with their concentration, as they had to “tune it out” to focus on visual cues to guide their actions at first.
However, our top players (who concluded four days of play in our Videogame Lab with the highest scores) were different: They tended to play better with the game sound on (full music and sound effects coming from both screen and Wiimote) from the very beginning.
The best players seemed to be better at paying attention to—and meaningfully integrating—both audio and visual cues effectively—thus benefitting from the richest warnings/clues/feedback. While the typical player strongly favored one sense, the best players were truly playing an audio-visual game from the beginning.
So…one secret to being a successful gamer may be to sharpen your attention to audio cues (in sound effects and music) within a game. Paying more attention to—and integrating—cues to both ear and eye may boost your game!
More than just high scores…
I’m also reminded of what a participant in our study expressed so well: “There’s more to a game than just high scores. It’s also about being transported and immersed in another world, and music and sound effects are what bring you there.”
Indeed, the lush cinematic scores take us through the emotional highs and lows of the journey of a game. Atmospheric tracks immerse us in other worlds. Rhythmic tracks serve as an engine to drive the action, the propulsion of the music making the virtual environment appear deeper and the visual array seem to whizz by faster (motion parallax).
When you have a great soundtrack, music can be the soul of a game.
© 2014 Siu-Lan Tan Ph.D
( ** see the Postscript below for a video interview featuring Quake III Arena and Mass Effects 3 video game composer Sonic Mayhem and the author of this blog **. This video interview can be found here )
Postscript: Sonic Mayhem!
Recently, I had a chance to speak with the much sought-after game music composer Sonic Mayhem (Sascha Dikiciyan), when we were both interviewed on video game music by Sami Jarroush for the well-known music blog Consequence of Sound.
Sonic Mayhem is one of the most sought-after video game music composers today. He scored Quake III Arena, Tron: Evolution, Mass Effect 2 & 3, Borderlands, Space Marine, James Bond: Tomorrow Never Dies, Mortal Kombat vs DC and a ton of other monumental games!
Here’s the video interview with Sonic Mayhem – and me (Dr. Siu-Lan Tan). Click HERE or on link below (interview starts at 04:20).
http://consequenceofsound.net/video/rock-it-out-blog-music-and-video-games-a-love-story/
- by Dr. Siu-Lan Tan, Associate Professor of Psychology, first author of Psychology of Music: From Sound to Significance (Psychology Press 2010, 2013) and primary editor of The Psychology of Music in Multimedia (Oxford University Press 2013).
My blog What Shapes Film? can be found by clicking here.
Acknowledgments
Many thanks to Sami Jarroush (Rock it out! Blog) for a great interview, Sonic Mayhem (Sascha Dikiciyan), Greg O’Connor-Read, and my collaborators John Baxa (at Carnegie Mellon) and Dr, Matthew Spackman. I'm also very inspired by the insightful writing of Dr Karen Collins on game sound. Check out an excellent example of her work here.
Sources
Cassidy, G.G. & MacDonald, R. A. R. (2009). The effects of music choice on task performance: A study of the impact of self-selected and experimenter-selected music on driving game performance and experience. Musicae Scientiae, 13, 357-386.
Grimshaw, M., Tan, S. L., & Lipscomb, S. D. (2013). Playing with sound: The role of sound and music in video games. In Tan, S. L., Cohen, A. J., Lipscomb, S. D., & Kendall, R. A., (eds.), The Psychology of Sound and Music in Multimedia. Oxford: Oxford University Press.
Tafalla, R. J. (2007). Gender differences in cardiovascular reactivity and game performance related to sensory modality in violent video game play. Journal of Applied Social Psychology, 37, 2008-2023.
Tan, S. L., Baxa, J. P., & Spackman, M. P. (2010). Effects of built-in audio versus unrelated background music on performance in an adventure role-playing game. International Journal of Gaming and Computer-Mediated Simulations, 2 (3), 1-23.
Tan, S. L., Baxa, J., & Spackman, M. P. (2012). Effects of built-in audio versus unrelated background music on performance in an adventure role-playing game. In Ferdig, R.E. & de Freitas, S. (Eds.) Interdisciplinary advancements in gaming, simulations and virtual environments: Emerging trends, pp. 142-164. Hershey, PA: IGI Global.
Yamada, M., Fujisawa, N., Komori, S. (2001). The effect of music on the performance and impression in a racing game. Journal of Music Perception and Cognition, 7, 65-76. [In Japanese]
