You Really Can't Always Believe Your Eyes--And Linguistics Proves It...

Words and language Twitter account @HaggardHawks recently spread its wings over to YouTube , and this week posted a language experiment explaining one of the most bizarre linguistic phenomena discovered in recent years.

The McGurk Effect was discovered in 1976 by the British psychologist and linguist Harry McGurk. An expert in child language acquisition, McGurk reportedly discovered his "effect" by accident when, during preparation of a separate language experiment, he happened to replay the audio of one phoneme over video of another. And the result was--well, something very unusual indeed.

FYI--not to spoil the surprise, you're probably best off watching the video first. Otherwise, spoiler alert!

As the video explains, as much as we might think of speech perception as being a purely auditory, sound-based process, the McGurk Effect neatly proves that there is in fact just as much (if not more) visual information being analysed--it's just that it all happens so quickly and automatically, that we're unaware of it happening. But if the information being provided by our eyes and our ears don't match, then our brain doesn't quite know what to do. So watching a video of someone saying far while hearing audio of them saying bar leads to some considerable confusion.

When this happens, in some cases the brain ignores the auditory information entirely and instead trusts the information being provided by the eyes without question--if that's you, then watching the tape in the YouTube video , you'd have been convinced that the fourth word was far.

In other cases, however, the brain mixes the two conflicting streams of information together, thereby convincing itself that what it's seeing and hearing is, in fact, neither of the things that it's actually seeing or hearing--and if that's you, then like the guinea pig in the video, you likely thought the fourth worth on the tape was var rather than far. Likewise, in McGurk's original experiment , he found that playing the sound ba-ba over a tape of someone saying ga-ga led to him interpreting it as da-da.

So what does all this prove? Well, the McGurk Effect demonstrates just how much visual information is utilised by our brains while we're processing speech, and how quickly our brains are to ignore auditory information--which we might think of as the cornerstone of speech perception--in favour of visual information. This has all kinds of implications on how we acquire language in the first place, what kind of sensory hierarchy must be going on in our brains, and what our brains have to do when this process is disrupted by, for instance, blindness, deafness, or trauma to the language-processing part of the brain. And the more we understand about that, the better we'll become at fixing it when it goes wrong.

For more information on the McGurk Effect, you can take a look at McGurk's original 1976 paper, Hearing Lips and Seeing Voices, here .

* This blog post originally appeared on the HaggardHawks language blog, haggardhawksblog.blogspot.co.uk