Why Perception Isn’t Just What We Sense

I first encountered the McGurk effect in a neuroscience class. My professor played a video of a person moving their lips as if saying “ga,” while the audio track played “ba.” Most students heard neither. They heard “da or ka” — a third sound created by the brain.

My experience was different. When I focused on the sound, I heard “ba.” When I watched the lips, I perceived “ga.” My perception followed where my attention was, rather than blending the two into something else. At the time, I didn’t think much of it. But, it was a useful clue.

As I learned more, I realized that sensory illusions aren’t tricks at all. They’re shortcuts the brain sometimes uses. Most of the time, perception works because the senses cooperate. Sight, sound, and touch usually point to the same event, arriving close together in time. When that happens, the brain doesn’t need to think very hard about what belongs together. The world feels stable. Neuroscientists call this multisensory integration. In everyday terms, it’s the brain weaving separate signals into a single story. Most of the time, we never notice the weaving. Illusions are what happen when the stitching shows.

When the Brain Chooses Coherence

Take another familiar illusion, the stream-bounce illusion. You watch two dots move toward each other on a screen. When they meet, some people see them stream through one another. Others see them bounce apart. Add a brief clicking sound at the moment they meet, and something interesting happens. Suddenly, a bounce feels obvious. Nothing about the visual scene changed. The sound didn’t add detail—it added certainty. The brain had an ambiguous situation and resolved it using whatever information was available. That’s not an error. It’s efficiency.

I’ve always found moments like this revealing. They show that perception isn’t about recording the world perfectly. It’s about deciding what’s most likely happening, given limited information. When everything lines up, that process feels effortless. When it doesn’t, the work becomes visible.

When Timing Starts to Matter

Some illusions go even further, like the double-flash illusion. Show someone a single flash of light. Pair it with two quick beeps. Many people will insist they saw two flashes. Sound has changed vision. This happens because the brain uses a brief window of time to decide which sensory events belong together. In neuroscience, this is called the temporal binding window. When sights and sounds arrive close enough together, the brain treats them as part of the same moment—even if that means shaping the experience to feel coherent. Timing matters more than we usually realize.

I notice this sensitivity most when things are slightly out of sync. A voice that arrives a fraction of a second late. A video call where expressions and sound don’t quite line up. Nothing is “wrong,” but my attention locks onto the mismatch. For many autistic and ADHD people like me, these small timing differences don’t fade into the background. They stay present. Each one demands a decision: Does this belong together, or not? That decision takes energy.

When Touch Isn’t Just Touch

Some of the most surprising illusions involve touch. In one experiment, people rub their hands together while listening to the sound through headphones. By subtly changing the sound—boosting certain frequencies—the skin can feel drier or rougher. Nothing about the hands changed; the interpretation did in this parchment skin illusion.

I like this illusion because it undermines a common assumption: that sensory discomfort always originates at the surface. Often, it emerges from the interaction between senses, not the intensity of any one signal. That’s why the same environment can feel fine one day and unbearable the next. Context changes how the brain resolves what it’s sensing.

Not Everyone Uses the Same Shortcuts

Here’s where my earlier classroom experience starts to make sense. Illusions work best when the brain relies heavily on automatic assumptions—about timing, about unity, about what usually goes together. When those assumptions are applied more cautiously, the illusion loses some of its pull. In my case, perception tended to follow attention rather than fusing signals automatically. The information stayed separate unless I deliberately brought it together. Research suggests that many autistic individuals show a similar pattern. This isn’t an absence of integration. It’s a different strategy for integration.

Autism Essential Reads

What Happens When You Stop Fighting Yourself

Autism and Vaccines: Questions Science Hasn’t Settled

What’s gained is fidelity. What’s lost is ease.

Perception becomes more deliberate, more precise, and, in complex environments, more effortful.

What the Illusions Reveal

Source: AI-Generated

Across these illusions, the same pattern keeps appearing. The brain prioritizes coherence over accuracy. It wants one stable story—even if that story requires a bit of creative editing. When the world cooperates, perception feels smooth. When it doesn’t, perception becomes work.

Autism and ADHD reflect different ways of resolving sensory information. They reflect nervous systems that are often resolving more ambiguity, more often, with less reliance on shortcuts. What’s often interpreted as sensory difficulty is sustained problem-solving.

A Different Way to Think About Sensory Differences

Sensory illusions are entertaining because they surprise us. But they’re also instructive. They show that perception is active, strategic, and shaped by context. It’s a negotiation under uncertainty. Autistic and ADHD experiences don’t sit outside that negotiation. They make it visible. When we understand that, the goal stops being to toughen people up or eliminate every stimulus. Instead, it becomes about reducing unnecessary conflict and creating better timing, better alignment, and fewer moments where the brain has to invent reality just to keep going.

Sometimes, the illusion isn’t the problem. It’s the clue.