High-performance brain-to-text communication via handwriting
12 May 2021
| Brain–computer interfaces (BCIs) can restore communication to people who have lost the ability to move or speak. So far, a major focus of BCI research has been on restoring gross motor skills, such as reaching and grasping or point-and-click typing with a computer cursor. However, rapid sequences of highly dexterous behaviours, such as handwriting or touch typing, might enable faster rates of communication. Here we developed an intracortical BCI that decodes attempted handwriting movements from neural activity in the motor cortex and translates it to text in real time, using a recurrent neural network decoding approach. | |
| With this BCI, our study participant, whose hand was paralysed from spinal cord injury, achieved typing speeds of 90 characters per minute with 94.1% raw accuracy online, and greater than 99% accuracy offline with a general-purpose autocorrect. To our knowledge, these typing speeds exceed those reported for any other BCI, and are comparable to typical smartphone typing speeds of individuals in the age group of our participant (115 characters per minute). Finally, theoretical considerations explain why temporally complex movements, such as handwriting, may be fundamentally easier to decode than point-to-point movements. Our results open a new approach for BCIs and demonstrate the feasibility of accurately decoding rapid, dexterous movements years after paralysis. | |
| Author(s) | Source |
| Willett FR, Avansino DT, Hochberg LR et al. | Nature 593, 249–254 (2021) https://doi.org/10.1038/s41586-021-03506-2 |
| This is a post of a scientific or business information. The information given here is checked thoroughly by “Implant-Register”. However we can´t be responsible for the content. The content usually is shortened to make it understandable for many. Read the linked original text if you are interested. Contact the publisher, if you have questions. You may inform us about changes of the information to improve the Register. | |
| Comments: n/a let us know |
|
Find NEWS and PUBLICATIONS here according to your interests or use the search box.
