Restoring Senses Introducing the Brain Interfacing Technology for Artificial Vision and Touch

Patients can now be treated for sight loss as well as for loss of motor-function with the help of advanced brain interfacing technology. Brain-computer interfaces are now being used for restoring more than one lost sense in the body.

Gothenburg/Sweden – Patients with untreatable conditions such as sight loss or loss of motor-function could be closer to a viable technology for restoring their lost sense, within a faster time frame. This is due to the discovery that advanced brain interfacing technology used for both touch and vision prostheses, is in fact almost the same, despite being developed completely separately for more than 50 years. The comprehensive review in which this discovery has first been made, was published in Nature Reviews Bioengineering, and was led by Giacomo Valle, Assistant Professor at Chalmers University of Technology, in Sweden.

Despite being developed separately, brain-computer interfaces or BCIs are an emerging field of technology that are being used for restoring more than one lost sense in the body, with visual cortical prostheses (VCP) for vision, and somatosensory cortical prostheses (SCP) for touch.

BCIs work by implanting a microelectrode directly into the brain, to enable direct communication between the brain and external devices (such as a camera or a bionic hand). They can bypass the damaged pathways in the body by directly stimulating a specific region of the brain and mimicking a natural sensation in a patient.

“This technology presents a real step forward for patients with otherwise untreatable conditions, in both the fields of sight-loss and loss of motor-function (such as paralysis), giving the ability to control movements, communicate or regain tactile sensation or vision, which previously was not possible”, says Giacomo Valle.

One technology, two separate senses

Natural vision and touch have common neural and computational principles in the body; whereby complex information is gathered from the outside world (via the eye or the skin/ hand) and converted into an electrical signal for the brain. Both fields of research have therefore been able to use similar technology to replicate these sensations artificially, with the BCIs placed in different regions of the brain. Yet neither field has spoken to each other until now.

“Normally people work on artificial touch or artificial vision. Researchers go to different conferences and deal with very different conditions and different patients, in different areas of the hospital. There has been parallel development for both senses, but we never talked about this on a global level. Until now, we hadn’t seen this as a common challenge”, says Valle.

The inspiration behind the review

The review paper ‘Restoring vision and touch with cortical microstimulation’ compares visual and sensory prostheses side by side for the first time and discusses how the two fields of research can learn from each other. It looks into how electrical stimulation of the cerebral cortex works, the types of electrodes used, how artificial visual and tactile experiences are created, the results of clinical trials to date and what technical and clinical barriers remain.

“The idea of merging the two fields of research came from the last paper that I worked on. We were going beyond restoring a simple sense of touch, moving to more complex sensations. We had to consider how to restore the sense of an edge or tactile motion. And through research, I found that the field of artificial vision was looking at the same challenge, aiming for a more complex artificial vision,” says Valle.

He points out that in the past, sight-loss and paralysis have been two very different fields of research, with unique challenges and different approaches to solving how to restore these in the body. But with the ongoing and rapid development of technology, these two fields have reached a coalescence.

“Hopefully our paper opens doors for a beneficial collaboration between the two fields and brings us closer to one technology for both artificial vision and touch that would benefit both patient groups. I have a dream for the future that there is one department in the hospital where a patient can go for ‘sense restoration’ and our unified technology would be easily accessible for all,” says Valle.

More about the scientific review:

The review ‘Restoring vision and touch with cortical microstimulation’ has been published in Nature Reviews Bioengineering. The authors are Giacomo Valle, Denise Oswalt, Robert A. Gaunt, Pieter Roelfsema, Charles M. Greenspon & Eduardo Fernandez. At the time of the review, the researchers were active at Chalmers University of Technology in Sweden; University of Pennsylvania; University of Pittsburgh; Netherlands Institute for Neuroscience, VU University, Amsterdam, the Netherlands; Academic Medical Centre, Amsterdam, the Netherlands; Sorbonne Université, Institut de la Vision, Paris, France; University of Chicago; University Miguel Hernández, Elche, Spain; John Moran Eye Center, University of Utah; Radboud University, Nijmegen, the Netherlands.

(ID:50933864)