Photo of The brain on music holds promise for communications technology
February 2016

The brain on music holds promise for communications technology

by Lindsay Jolivet Azrieli Program in Brain, Mind & Consciousness News 27.01.2016

Imagine sitting at the computer and singing David Bowie’s “Let’s Dance” in your head, then waiting as your computer reads the electrical activity in your brain and plays the song.

Koerner Fellow Adrian Owen (Western University) has imagined this and more. Owen, the co-director of the Azrieli Program in Brain, Mind & Consciousness at CIFAR, is pursuing an emerging line of research known as music imagery information retrieval (MIIR).

But he’s less interested in helping people access songs, and more interested in how computer interfaces that combine music and recordings of electrical activity in the brain could help patients with severe brain injuries communicate. This could work in many ways.  Owen gives the example of a wheelchair.

“If you were a paralyzed patient and you were operating your own wheelchair, for example, you would sing one song in your head to make it go left and a different song in your head to make it go right,” Owen says.

Researchers must resolve many challenges for this vision of the future to become reality. As a step forward, Owen’s lab has created an open access dataset for researchers all over the world to collaborate on advancing the field. OpenMIIR is a compilation of electroencephalography (EEG) recordings taken while people were either listening to music or singing a song in their heads. Western University has some of the most sophisticated EEG equipment in the world, which allows for high quality recordings.

So far the database contains recordings from 10 people listening to music from different genres, at different tempos, with and without lyrics. The recordings have revealed that when someone imagines a song, the electrical patterns in their brain look relatively similar to when they are actually hearing the song.

“We obviously need to go much further than that because I want to be able to just work out what you’re singing in your head right now,” Owen says. He says his team is focusing on music because humans are very good at imagining songs. We do it naturally, sometimes even when we don’t want to, if there is a tune stuck in our heads.

His team has had success asking subjects to imagine other things. In a remarkable breakthrough reported in 2010, he communicated with a vegetative patient using functional magnetic resonance imaging (fMRI) for the first time by asking him to imagine playing tennis. But tennis doesn’t work as well with EEG recordings, which might be a more promising technology. MRI machines are not portable and they are very expensive.

“We’ve been working hard to try and come up with an EEG-based method for both identifying consciousness in these patients and for communicating with some of them,” Owen says.

He says the question requires the efforts of scientists in many disciplines, from neuroscientists to experts in information retrieval, mathematicians, engineers and more. Ethicists, lawyers and spiritual leaders are important for grappling with what to do when vegetative patients tell us what they want.

“It’s multidisciplinary like you couldn’t imagine.” He says that’s why he approached CIFAR to create a new research program, now named the Azrieli Program in Brain, Mind & Consciousness, to sustain long-term collaboration between experts in many fields on big questions around consciousness.

Image above: A student in Adrian Owen’s lab places an EEG cap on another student.

Leave a Comment

Your email address will not be published.

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong>

More From This Issue


Beyond excellence

Over the holidays I read an excellent book by Peter MacKinnon, past president of the University of Saskatchewan. During his…


Recent awards and honours, February 2016

New Order of Canada appointee CIFAR Senior Fellow Brenda Andrews (University of Toronto), of the program in Genetic Networks, has…


The brain’s memory system points to more efficient computing methods

The brain could have 10 times as much storage capacity as we originally thought, according to new findings about the…


Conflict at school drops when students take the lead

The best way to reduce bullying and conflict in schools could be to involve the experts: the students. CIFAR Fellow…


Machine learns to read, write and invent handwritten characters like us

A new computer model learns to recognize and create handwritten characters  just as well as people, and can even invent…

Related Ideas

Azrieli Program in Brain, Mind & Consciousness | News

Researchers detect response to humour in patients in a vegetative state

Researchers have shown for the first time that a patient in a vegetative state can exhibit an external emotional response...

Azrieli Program in Brain, Mind & Consciousness

Howling dogs give insights into language

Dogs howling to the theme song from “Law and Order” could give us insight into how humans became a musical...

Azrieli Program in Brain, Mind & Consciousness | News

Beyond ‘levels’ of consciousness

To understand consciousness, researchers need to go beyond the idea that it can be measured on a single scale. Instead,...

Azrieli Program in Brain, Mind & Consciousness | News

Azrieli Foundation makes a visionary gift of $10 million to CIFAR

CIFAR announced a historic $10 million gift from The Azrieli Foundation at a special event Thursday night, June 9, 2016,...

Azrieli Program in Brain, Mind & Consciousness | News

Where does the brain do math?

Is higher mathematical reasoning related to the human capacity for language? Or does it depend on parts of the brain...