Imagine this scenario. It’s almost Christmas. And, you’re in a Hilton hotel bar- teeming with people celebrating, virtually wall to wall. And, you hear a voice. And, recognize it as that of a friend from decades past. “Jeffrey Fried, where are you?”, I call out. Seconds later… “Roy?”. I hadn’t seen Jeff in 21 years. But, I recognized his voice. (Which restarted our friendship for another decade, until I got married and moved away. Jeffrey Fried- where are you?)
That scenario describes one that scientists term the “cocktail party effect” (the ability to pick out a voice in a crowd). And, Drs. Nima Mesgarani and Edward Chang (UC San Francisco) advanced the state of the art using three epileptic volunteers, as they reported in Nature. These three subjects had electrode arrays already implanted in their brain to help control their seizures. (We’ve discussed this concept before… Deep Brain Stimulation, where patients agree to have electrodes implanted in various parts of their brain to stimulate different reponses.)
Drs. Mesgarani and Chang were able to monitor the subjects to determine which neurons were active in response to specific sound frequencies. From that data, they were able to produce a spectrogram- a print-out of the sound properties and the time frame of occurrence. (These graphs are sometimes called voicegrams or voiceprints.)
Once these spectrograms were developed, the researchers went about examining the cocktail party effect. The subjects were asked to listen to voice recordings from a man and woman. Their task was to discern when a certain key word was spoken by either of them (they were not told which person would employ the word)- and then focus only on that voice from then forward. And, the researchers found by monitoring the subject’s brain activity, they could discern which voice the subjects were “hearing”. This was true whether the subjects were paying attention to the correct speaker or not.
The next goal for this research is to refine the algorithms so that voice recognition systems can decipher specific speech in situations where there are multiple speakers. Given that solution, we can have computers find that voice in a crowd- or transcribe conversations or speeches with significant background noise.
Great info. I have watched on tv when the dr.’s performed the surgery putting the probes in just the right spot to help stop the seizures. I think modern medicine is amazing.
shawn recently posted..The Grass on the Other Side is NOT Greener!
I still shudder at the thought of implanted electrodes. I know they work, but the concept that someone else can control my brain, Shawn….
So is this how/when “selective hearing” occurs?
I think the “selective hearing” to which you refer is more a function of “tuning out”. Unless you mean, for example, a parent hearing their child cry out in a gaggle of toddlers….
Roy
Amazing. I have never really thought about how we might recognize the voices we know even in a crowd. Science is exploring some interesting aspects of how our brain works. However Roy, I’m with you on the idea of having electrodes implanted in my brain…creepy even if it does help some.
Bonnie recently posted..An Important Truth About Mindset
Yup, Bonnie. It’s pretty clear to me (even in a crowded room) that I would not be among the subjects for this study.
Gotta love medicine and research. Who knows what to expect a decade from now. I grew up in a medical household and it’s amazing how much it changes.
Interesting post.
Cindy
Cindy Murphy recently posted..An Inexpensive Way To Outsource A Kindle Book
Yes, Cindy, a lot of these projects are not only intriguing- but they will make a difference in OUR lifetimes- which is a lot sooner than our kids’.
I thought the cocktail effect came from a different source. Eager for gossip or connection. I think I will just keep avoiding them as the noise volume just gives me a headache
Roberta Budvietas, recently posted..Until You Get it Back….
I’ll make sure to remember that the next time I have one, Roberta.
I just learned the other day about a dictation app that you can literally speak your blog post into and it will write it for you. I suppose it could be based on this study that you share here Roy. Interesting information for sure!
Lynn Brown recently posted..Increasing Traffic To Your Blog With Twitter
That technology is very different. We have been able- with varying degrees of success- to dictate into computers (and since smart phones have computer chips, for the purposes of this discussion, Lynn, they are computers as well) after we have trained the application to recognize of speech patterns.
This application detects sounds among a cacophony- which means, for example, if the computer HAS been trained to identify your voice, it could transcribe your remarks among all the other conversations. Or, if all the speakers’ patterns have been identified, a complete transcript of a meeting could be automatically produced!
Roy
Amazing, I didn’t know that before. It’s so nice to learn something new every day. Thanks for sharing!
Dane Bjerno recently posted..Feel Good Fashion – Eco-Friendly Spring Sandals & Shoes
Dane:
It’s a pleasure to “meet” you. I’m so glad you liked this post. Thanks for reading my blog- and leaving a comment. I look forward to our next “conversation”.
Roy
I’m with you, there shall be no electrodes in my brain while I still have breath in my body. But the innovations are amazing, the growing understanding of our minds is amazing…10 years from now I think we’ll look back to now and be amazed at how primitive our understanding was. Kind of like how we look at the early 1900s. Love the information!
Interesting, Roy. I hope you find your friend again. For my mom’s 70th birthday we had a surprise party. My sister from WA flew in and infiltrated the party mid-stream. She walked up behind my mom, who is quite sharp by the way, and said “Happy Birthday.” Mom didn’t recognize her voice at first. I guess sometimes the opposite is true – you know a voice very well but know it doesn’t belong where you are and your brain doesn’t register.
Bonnie Anderson recently posted..Please Read This Yesterday
Oh, Bonnie- that is not generally the case. It could be that the noise in the party was at the same frequency as your sister’s voice, which might have masked it. Otherwise, I would aim for a quick hearing check… Really.
Wow. That is amazing. Right now, though, I hope they improve the voice recognition program on my “smart” phone because it texts in some really absurd stuff sometimes!
Carolina HeartStrings recently posted..WORDLESS WEDNESDAY
Alessa:
The problem with your smart phone is that it may be “smart” when compared to another phone, but it’s IQ is limited by the strength (processing power) of the chip that drives the unit. This is akin to the issue of the first speech recognition systems that were relying on 90286 chips. The science was there- but the processing power was not, so more errors occurred. As the “brains” of the units (the processing power) increased, the recognition capabilities increased dramatically.
Roy
Dare I say it sounds very similar to how content is found online using keywords?
In order to break up the noise a user on the internet types in search term or keyword in to a search engine.
That search engine filters out the surrounding noise and presents back to the user a list of potential conversations or messages to pay closer attention to.
James Debono recently posted..Marketing with Social Media – Grow A Loyal Community by Increasing Your Worth!
James:
One could consider that akin- but I believe the search engines are different in that they are already programmed to seek out the words chosen for keywords and/or to read the titles of a page.
In this case, it’s closer to a needle in a haystack in that we don’t know for what we are looking, but recognize familiarity once we hear it. Using a search engine similarity, it would be akin to finding the name of the author for each page, since their “voice” would be understood from the vernacular, idioms, and structure.
Roy
Thanks for sharing your thoughts about cocktail party effect.
Regards
انواع المبيدات الحشرية المنزلية recently posted..انواع المبيدات الحشرية المنزلية
Honored by your visit and your comment.
Very nice post. I just stumbled upon your weblog and wanted to
say that I have truly enjoyed browsing your blog posts.
In any case I will be subscribing to your feed and I hope you write again very
soon!
Jacob recently posted..Jacob
Thanks so much, Jacob. I look forward to seeing you comment again!
Do you mind if I quote a couple of your posts as
long as I provide credit and sources back to your webpage?
My blog is in the exact same area of interest as yours
and my users would definitely benefit from a lot of the information you provide here.
Please let me know if this ok with you. Many thanks!
best mens cologne ever recently posted..best mens cologne ever
With credit provided, I am always honored by such efforts. Thanks, Mr. Cologne.