As the participant imagined writing a letter, sensors implanted in his brain picked up on patterns of electrical activity, which an algorithm interpreted to trace the path of his imaginary pen. Credit: F. Willett et al./Nature 2021.
The imagined handwriting of a person with paralysis can be translated into text through a brain–computer interface (BCI) that was faster than other types of assistive communication, Axios’ Eileen Drage O’Reilly reports.
Why it matters: While the interface was only tested in one person and is a proof-of-concept finding, some experts say it’s an “important milestone” in developing the technologies needed by millions of people globally who’ve lost the ability to use their upper limbs or the ability to speak due to paralysis, strokes or Lou Gehrig’s disease.
Details: The team of researchers, whose trial is part of an international collaboration called BrainGate2, implanted electrodes on the surface of the brain of the participant (who is paralyzed from the neck down) to study the complex patterns of neural activity used when visualizing the task of handwriting individual letters.
- They were able to decode the electrical activity from about 200 different neurons into a prediction of what letter the person was wanting to make, says study co-author Krishna Shenoy, a professor of engineering at Stanford University.
What they found: The participant was able to compose sentences and communicate at a rate of about 90 characters per minute with a 94% raw accuracy and 99% accuracy with autocorrect, according to the results published in Nature.
- This compares with existing communication BCIs that use the brain to “point and click” on letters at a pace of about 40 characters per minute.
What they’re saying: Jennifer Collinger, associate professor at the University of Pittsburgh’s Rehab Neural Engineering Lab who was not part of this study, says the findings are “exciting and interesting” for several reasons.
- One is that from a practical communications standpoint, the new technique appears to double the current rate of assistive communications, Collinger says.
- “But, more than that, I would not have thought to try to decode handwriting. It seems like a very challenging problem: How is that going to be better than accessing an onscreen keyboard that people have been working towards for decades? The fact they were able to achieve such a high level of performance is really, really interesting,” she says.
What we’re watching: “The future really is — as we learn more and more about the brain — [that] we should be able to interact with it and help overcome dysfunction as well as to understand how it normally functions,” Shenoy says.
Leave a Reply