Neuroscientists have trained a neural network to translate brain signals into intelligible speech

Date:

2019-01-30 03:00:26

Views:

1789

Rating:

1Like 0Dislike

Share:

Neuroscientists have trained a neural network to translate brain signals into intelligible speech

Using the technology to scan brain activity, artificial intelligence and speech synthesis, scientists from Columbia University (USA) have created a device that can translate a person's thoughts in articulate speech. The results of a study in the journal Scientific Reports, represent an important step in improving interfaces "brain — computer". In the future, such devices will be able to use the people who have lost the ability to speak as a result of injury or disease.

To develop the device that connects the possibilities of speech synthesis and artificial intelligence the study's author, neuroscientist Nimes, Masharani and his colleagues turned to the most recent advances in deep machine learning and technology speech synthesis. The result of their work was the vocoder on the basis of artificial intelligence, the ability to accurately interpret brain activity directly from the auditory cortex of the brain, and then translate it into visible speech. The authors note that the speech in this case is highly computerized, but people can recognize words in most cases.

According to the creators, the new device used for playback of the resulting speech, used the same technology that is used in digital assistants such as the Alexa, Siri and Assistant.

The team First trained the vocoder correctly interpret the brain activity of a person. To do this, scientists were invited to participate in the experiment, five volunteers, who at the time was undergoing treatment for epilepsy. All five in the auditory cortex was implanted electrodes to read electroencephalography.

"We asked patients with epilepsy who are undergoing surgical treatment on the brain, listen to suggestions, which is pronounced by different people. At the same time, we analyzed patterns in the brain activity of patients. The obtained neural models and studied the vocoder," says Massarani.

The Patients were asked to listen to the recording, in which actors read out sequences of digits from 0 to 9. At the same time, the scientists recorded brain signals, and then passed it through a vocoder, the signals for which to enhance the clarity adjust the neural network, analyze the sounds of the vocoder, uttering sounds in response to these signals. As a result, you could hear a robotic voice, repeating the sequence of spoken numbers. To measure results, researchers recruited 11 people with excellent hearing.

"it Turned out that people can recognize the words about 75% of the cases, significantly superior to any previous attempts. Delicate vocoder and powerful neural network generated sounds that are listened to patients with surprising accuracy", — says Massarani.

In the future, the team Masharani's going to teach a neural network to pronounce more complex words, phrases and even whole sentences. After that, they want to develop an implant that can translate human thoughts into a full-fledged speech.

"For example, if the owner of the implant will think: "I need a glass of water" — our system considers the brain signals and translate them to speech. This will give anyone who has lost the ability to speak due to injury or illness, a new opportunity to communicate with the outside world," adds Masharani.

To Discuss the development of the American scientists in our .

Recommended

The Oculus zuest 2 virtual reality helmet for $300. What's he capable of?

The Oculus zuest 2 virtual reality helmet for $300. What's he capable of?

Why is the new Oculus zuest 2 better than the old model? Let's work it out together. About a decade ago, major technology manufacturers introduced the first virtual reality helmets that were available to ordinary users. There were two ways to find yo...

The mysteries of neurotechnology - can the brain be used as a weapon?

The mysteries of neurotechnology - can the brain be used as a weapon?

DARPA has launched the development of a neural engineering system to research a technology that can turn soldiers into cyborgs Despite the fact that the first representatives of the species Homo Sapiens appeared on Earth about 300,000 - 200,000 years...

What materials can be used to build houses on Mars?

What materials can be used to build houses on Mars?

Marsha constructions n the surface of the Red Planet SpaceX CEO Elon Musk is hopeful that humans will go to Mars in the next ten years. Adapted for long flight ship Starship is already in development, but scientists have not yet decided where exactly...

Comments (0)

This article has no comment, be the first!

Add comment

Related News

Space tourism, asteroid and other news of high technologies

Space tourism, asteroid and other news of high technologies

What part of speed of light should be the velocity of the particle to its kinetic energy were equal to its rest energy? We know the answer, and I know what happened in the world of high technologies for the last week. 1. Soon we...

Dubai will sell prepared coffee in space

Dubai will sell prepared coffee in space

the Startup of the UAE under the name of claims to have invented a better way of roasting coffee beans to perfect coffee. How? With the help of the atmosphere, of course. More precisely, using intense heat to be created inside a s...

Improve the algorithms of AI will lead to a revolution in prosthetics

Improve the algorithms of AI will lead to a revolution in prosthetics

Teaching artificial intelligence using the method of trial and error when the computer is "fed" recordings of the huge amount already wagered parties on the basis of which he hones his skill, proved that the machine is able to out...