Synchron has developed a brain-computer interface (BCI) that uses existing stent and catheter technology to implant the device into the brain without the need for open craniotomy.
The device, called Synchron Switch, enters the brain through the jugular vein and is implanted near the motor cortex. It can receive movement signals from the brain and wirelessly control external devices. The technology is designed to help people who are paralyzed by ALS, stroke, injury or other diseases, enabling them to input texts, shop, bank operations, etc. through brain control technology.
Recently, Synchron is experimenting with integrating ChatGPT into its brain-computer system to make it easier for paralyzed patients to control their digital devices.
By implanting BCI, the patient’s communication problem can be well solved, but typing word by word is still very time-consuming.
An old man communicates with computer with chatgpt implanted in his brain
Mark, who was diagnosed with ALS in 2021 and now describes the use of his hands as “almost gone,” is one of 10 clinical trial participants around the world to receive a Synchron BCI implant.
Mark demonstrated how ChatGPT can help Synchron’s BCI type and communicate.
Now, he no longer needs to type it word for word, each response can be completed with a single “click”. If the AI’s answer is not correct, there is also a refresh button, and Mark noticed that the answers provided by the AI are more and more consistent with what he might say.
User interface of computer controlled by the man
“Occasionally it breaks out into a curse word, which is something I occasionally say,” he said with a laugh.
Synchron CEO Tom Oxley told me that the company has been experimenting with different AI models for about a year, but the release of OpenAI’s ChatGPT-4o version opened up some interesting new possibilities.
How Synchron’s BCI integrates GPT
Integration
Synchron’s brain-computer interface (BCI) integrates OpenAI’s ChatGPT in the following ways:
1. Hardware
Synchron’s BCI device, called a stentrode, is implanted in a blood vessel near the brain’s motor cortex through a minimally invasive procedure.
The device is able to read the brain’s electrical signals and transmit those signals wirelessly to an external device.
2. Software
OpenAI’s ChatGPT is integrated into Synchron’s BCI software. ChatGPT is a large language model that can understand and generate natural language text.
The user triggers the BCI by thinking a movement, thereby selecting a response option generated by ChatGPT.
3. Interaction process
Users control BCI devices through brain activity.
BCI devices read brain signals and interpret user intentions, translating those signals into digital commands.
ChatGPT provides predicted response options based on the context, and users complete the communication or operation by “clicking” to select the most appropriate option.
Main Features of BCI
Assisted Communications
ChatGPT helps generate pre-set answer options, and users can quickly select appropriate answers through BCI, greatly improving communication efficiency.
In this way, users do not need to enter word by word, saving a lot of time.
2. Smart Prediction
ChatGPT uses contextual information to predict the user’s possible answer options. For example, in a conversation, the system will generate possible answer options based on the previous content for the user to choose.
If none of the AI’s answers are correct, there is also a refresh button that refreshes the options.
This prediction can greatly reduce the workload of user input and improve the naturalness and fluency of responses.
3. Multimodal Input
ChatGPT-4o (omni version) can accept text, audio, and visual input, which means that in the future contextual information can be provided in multiple ways to help generate more accurate and relevant responses.
4. Adaptive Learning
As usage time increases, the system will gradually learn and adapt to the user’s language habits and preferences, improving the accuracy and personalization of responses.
Feedback from users (such as clicking or not clicking certain options) can be used to tune and optimize the system’s predictive capabilities.
Oxley also said the company is not limited to any particular large language model. In the rapidly evolving field of AI, the system that best meets the needs of patients will be the one Synchron adopts.
Synchron’s implant, called a stentrode, is inserted into a blood vessel near the brain’s motor cortex, the part of the brain that controls our movements. To click or select with the Synchron BCI, the user imagines moving, and the BCI interprets those thoughts and performs the desired action on the user’s device via wireless transmission.
Synchron’s BCI connects a person’s brain directly to their device.
Synchron’s BCI is expected to cost between $50,000 and $100,000, comparable to the cost of other implantable medical devices such as pacemakers or cochlear implants. No implantable BCI has yet received market approval from the U.S. Food and Drug Administration, and Synchron hopes to change that. Although the process may take years, Synchron’s BCI is already making an impact.
“There is hope ahead,” Mark said, for anyone in a similar situation. Mark ended our conversation by encouraging people to get involved in finding solutions, “Whatever I can do to help others, I think that’s what we’re here for.”
