Photo of The brain on music holds promise for communications technology
February 2016

The brain on music holds promise for communications technology

by Lindsay Jolivet News Azrieli Program in Brain, Mind & Consciousness 27.01.2016

Imagine sitting at the computer and singing David Bowie’s “Let’s Dance” in your head, then waiting as your computer reads the electrical activity in your brain and plays the song.

Koerner Fellow Adrian Owen (Western University) has imagined this and more. Owen, the co-director of the Azrieli Program in Brain, Mind & Consciousness at CIFAR, is pursuing an emerging line of research known as music imagery information retrieval (MIIR).

But he’s less interested in helping people access songs, and more interested in how computer interfaces that combine music and recordings of electrical activity in the brain could help patients with severe brain injuries communicate. This could work in many ways.  Owen gives the example of a wheelchair.

“If you were a paralyzed patient and you were operating your own wheelchair, for example, you would sing one song in your head to make it go left and a different song in your head to make it go right,” Owen says.

Researchers must resolve many challenges for this vision of the future to become reality. As a step forward, Owen’s lab has created an open access dataset for researchers all over the world to collaborate on advancing the field. OpenMIIR is a compilation of electroencephalography (EEG) recordings taken while people were either listening to music or singing a song in their heads. Western University has some of the most sophisticated EEG equipment in the world, which allows for high quality recordings.

So far the database contains recordings from 10 people listening to music from different genres, at different tempos, with and without lyrics. The recordings have revealed that when someone imagines a song, the electrical patterns in their brain look relatively similar to when they are actually hearing the song.

“We obviously need to go much further than that because I want to be able to just work out what you’re singing in your head right now,” Owen says. He says his team is focusing on music because humans are very good at imagining songs. We do it naturally, sometimes even when we don’t want to, if there is a tune stuck in our heads.

His team has had success asking subjects to imagine other things. In a remarkable breakthrough reported in 2010, he communicated with a vegetative patient using functional magnetic resonance imaging (fMRI) for the first time by asking him to imagine playing tennis. But tennis doesn’t work as well with EEG recordings, which might be a more promising technology. MRI machines are not portable and they are very expensive.

“We’ve been working hard to try and come up with an EEG-based method for both identifying consciousness in these patients and for communicating with some of them,” Owen says.

He says the question requires the efforts of scientists in many disciplines, from neuroscientists to experts in information retrieval, mathematicians, engineers and more. Ethicists, lawyers and spiritual leaders are important for grappling with what to do when vegetative patients tell us what they want.

“It’s multidisciplinary like you couldn’t imagine.” He says that’s why he approached CIFAR to create a new research program, now named the Azrieli Program in Brain, Mind & Consciousness, to sustain long-term collaboration between experts in many fields on big questions around consciousness.

Image above: A student in Adrian Owen’s lab places an EEG cap on another student.

Leave a Comment

Your email address will not be published.

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong>

More From This Issue


Beyond excellence

Over the holidays I read an excellent book by Peter MacKinnon, past president of the University of Saskatchewan. During his…


Recent awards and honours, February 2016

New Order of Canada appointee CIFAR Senior Fellow Brenda Andrews (University of Toronto), of the program in Genetic Networks, has…


The brain’s memory system points to more efficient computing methods

The brain could have 10 times as much storage capacity as we originally thought, according to new findings about the…


Conflict at school drops when students take the lead

The best way to reduce bullying and conflict in schools could be to involve the experts: the students. CIFAR Fellow…


Machine learns to read, write and invent handwritten characters like us

A new computer model learns to recognize and create handwritten characters  just as well as people, and can even invent…

Related Ideas

Research Brief | Azrieli Program in Brain, Mind & Consciousness

Is today’s artificial intelligence actually conscious? Not just yet.

The computations that underpin current artificial intelligence (AI) more closely resemble unconscious processing than conscious thought in the human brain,...

News | Azrieli Program in Brain, Mind & Consciousness

What would it take for AI to achieve consciousness?

Imagine you’re on a business trip, driving from your hotel to a meeting with a client when your fuel light...

News | Azrieli Program in Brain, Mind & Consciousness

Our Brains Learn While They Sleep, New Research Finds

Scientists at Paris’s École Normale Supèrieure have shown that the brain can learn and form new memories while sleeping. The...

Video | Azrieli Program in Brain, Mind & Consciousness

Anil Seth: How Your Brain Hallucinates Your Conscious Reality

Right now, billions of neurons in your brain are working together to generate a conscious experience — and not just...