Posted on 04/26/2019 2:04:30 PM PDT by aimhigh
Researchers at UC San Francisco have a developed a brain-machine interface that may allow speech-impaired patients to “speak” through the device. The researchers have described the system as a stepping stone to neural speech prostheses. The system monitors the brain activity of a user and then converts this to natural sounding speech using a virtual vocal tract. This computer simulation includes anatomically accurate representations of a larynx, tongue, lips, and jaw.
Patients can lose the ability to speak because of a variety of factors, including neurodegenerative diseases, strokes, and brain injuries. Current assistive technologies can allow certain patients to spell out words using small facial movements and other techniques. While these technologies are undoubtedly very useful, it can be time consuming to communicate in this way.
To provide a better way for such patients to communicate, researchers have developed a brain-machine interface that can translate activity in the speech centers of the brain to natural sounding speech. This is a complex undertaking, as the way the speech centers coordinate the movements of the vocal tract is complicated.
“The relationship between the movements of the vocal tract and the speech sounds that are produced is a complicated one,” said Gopala Anumanchipalli, a researcher involved in the study. “We reasoned that if these speech centers in the brain are encoding movements rather than sounds, we should try to do the same in decoding those signals.”
The researchers created a virtual vocal tract and then used machine learning to get it to produce the correct sounds. Volunteers said specific phrases aloud while their brain activity was monitored. Machine learning was used to match these neural signals to movements in the virtual vocal tract that produced a natural sound that closely matched the original phrase.
“We still have a ways to go to perfectly mimic spoken language,” said Josh Chartier, another researcher involved in the study. “We’re quite good at synthesizing slower speech sounds like ‘sh’ and ‘z’ as well as maintaining the rhythms and intonations of speech and the speaker’s gender and identity, but some of the more abrupt sounds like ‘b’s and ‘p’s get a bit fuzzy. Still, the levels of accuracy we produced here would be an amazing improvement in real-time communication compared to what’s currently available.”
The researchers hope that the technology could provide a convenient and powerful way to communicate for those who cannot speak.
“People who can’t move their arms and legs have learned to control robotic limbs with their brains,” said Chartier. “We are hopeful that one day people with speech disabilities will be able to learn to speak again using this brain-controlled artificial vocal tract.”
Didn’t that fraud, Stephen Hawking, supposedly use something like this. Or was it some wizard behind the curtain?
I can imagine being at one of those incredibly boring “team building” classes at work, and suddenly the device starts synthesizing what people are actually thinking, instead of what they mean to say.
My thoughts exactly, no pun intended
I know what I’m thinking.
I’m looking at the cat standing at the open door and I’m thinking:
In or out, you’ve got 3 seconds.
Strangely, they can’t get it to work on Democrats.
I heard they tried this on some Democrats and all that came out was: Duuuuuuuuuuh
I've often thought "What an a***h*le!" during conference calls and meetings. Thankfully I never spoke out loud what I was thinking.
Not so sure it wasn’t on one of those creepy Saturday afternoon Japanese movies you couldn’t understand.
What happens when half the words that come out are expletives?
It’d be nice to see how well this would work for dogs.
(-:
I wonder how well it works for interrogation.
How about for people with locked-in syndrome?
https://www.theguardian.com/world/2012/aug/07/locked-in-syndrome-richard-marsh
What does work on democrats is a sewer pump.
That means its finally working 100% correctly.
Squirrel!
Oops, did I say that out loud?!?
Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.