Synchron Enables ALS Patient to Control Apple Vision Pro via Thought Using Minimally Invasive BCI

Source: Cailian Press

Synchron, a U.S.-based brain-computer interface (BCI) company currently enjoying strong venture capital momentum, announced on Tuesday that its BCI product has gained an additional application target—AppleThe company’s headset product, Vision Pro. Patients with physical disabilities can now control Apple’s flagship XR device using their thoughts.

First, a brief introduction: unlike Neuralink’s product under Elon Musk, Synchron’s brain-computer interface does not require drilling holes in the patient’s skull for implantation. Instead, it implants signal-collecting interfaces into the blood vessels on the surface of the brain's motor cortex via the jugular vein and wirelessly transmits data through a device worn on the chest.

Neuralink gained worldwide fame through Elon Musk, while Synchron also boasts an impressive investor background. Investment funds under Bill Gates and Jeff Bezos were among the early investors in this brain-computer interface company.

　　How to Control Vision Pro Without Using Hands?

Currently, a total of 10 patients worldwide have been implanted with Synchron's brain-computer interface products, and Mark, who suffers from amyotrophic lateral sclerosis (ALS), is today's protagonist.Since his diagnosis in 2021, Mark has lost control of his shoulder, arm, and hand., but they can still speak and walk short distances—these functions will also deteriorate as the disease progresses.

Because Apple’s Vision Pro requires gesture-based control, patients like Mark would normally be unable to experience it firsthand. However, advances in technology have made this possible. By implanting wires into Mark’s cerebral blood vessels, he can send signals directly from his brain, replacing gesture control to interact with the Vision Pro.

Based on the demonstration and introduction, Mark can send text messages to his daughter by “imagining his hand selecting a specific word.”

The same operation also applies to playing the card game Solitaire—Mark can select cards and move them to the target location using only his thoughts.

With this foundation, Mark can naturally select Apple’s streaming app via thought control and choose the TV series he wishes to watch.

Although these may seem like simple procedures to the average person, they remain an exciting development for Mark.Through a brain-computer interface, he has regained some of his independence as a human being, enabling him to operate by “thinking” rather than relying on others for every task.

According to reports, Mark received Synchron’s brain-computer interface (BCI) implant in August 2023. He met with the company twice a week for two-hour sessions to practice various functions of the brain-computer interface. Mark stated that he has been intermittently testing the Vision Pro since April this year.Although he can no longer raise his arms, he is exploring how to use the device for artistic creation through a brain-computer interface and Vision Pro.。

Readers of Cailianshe may vaguely recall this Mark. About half a month ago, Synchron announced that by integrating OpenAI’s latest artificial intelligence model, Mark can receive AI-generated response suggestions when chatting via a brain-computer interface, thereby allowing him to devote his valuable attention and energy to selecting responses rather than typing out individual words.

Tom Oxley, CEO and founder of Synchron, stated that while Vision Pro is a powerful system, it relies on gesture control. We are transmitting control signals directly from the brain to eliminate the need for gestures. The company is advancing toward a new Bluetooth standard for human-computer interaction.For millions of paralyzed patients, the ability to operate devices without touch or voice control remains an important unmet need.

He also stated that Apple’s iOS devices offer the best accessibility features among similar products, which is why the company initially focused on helping patients control devices within the Apple ecosystem. It may also strive to connect its brain-computer interface (BCI) with head-mounted displays from other companies in the future. He further revealed that Apple has consistently provided substantial support in the integration of brain-computer interfaces.

Responsible Editor: Li Tong