{"id":87,"date":"2016-04-20T14:38:39","date_gmt":"2016-04-20T14:38:39","guid":{"rendered":"https:\/\/blogs.mathworks.com\/headlines\/?p=87"},"modified":"2023-12-22T10:35:54","modified_gmt":"2023-12-22T15:35:54","slug":"neuroscience-and-machine-learning-restore-movement-in-paralyzed-mans-hand","status":"publish","type":"post","link":"https:\/\/blogs.mathworks.com\/headlines\/2016\/04\/20\/neuroscience-and-machine-learning-restore-movement-in-paralyzed-mans-hand\/","title":{"rendered":"Neuroscience and Machine Learning Restore Movement in Paralyzed Man\u2019s Hand"},"content":{"rendered":"<p>Last week, the <a href=\"http:\/\/www.nytimes.com\/2016\/04\/14\/health\/paralysis-limb-reanimation-brain-chip.html?emc=edit_na_20160413&amp;nlid=74317212&amp;ref=cta\" target=\"_blank\" rel=\"noopener\">New York Times<\/a> reported the first successful \u201climb reanimation\u201d in a person with quadriplegia. Ian Burkhart, 24, had broken his neck as a teen in a diving accident. His spine was damaged at the fifth cervical vertebra, leaving him paralyzed from the shoulders down.\u00a0Using nerve bypass technology that transmits his thoughts directly to his hand muscles, he has regained control over his right hand and fingers.<\/p>\n<p>The system effectively bypasses his spinal injury. This is the first time a brain-computer interface has been used to help an individual move his own hands.\u00a0The research was published in in the journal <a href=\"http:\/\/www.nature.com\/news\/first-paralysed-person-to-be-reanimated-offers-neuroscience-insights-1.19749?WT.mc_id=TWT_NatureNews\" target=\"_blank\" rel=\"noopener\">Nature<\/a>, and explains how <a href=\"https:\/\/www.mathworks.com\/campaigns\/offers\/common-machine-learning-challenges.html?s_eid=PSM_da\" target=\"_blank\" rel=\"noopener\">machine learning <\/a>and <a href=\"https:\/\/www.mathworks.com\/products\/matlab\/\" target=\"_blank\" rel=\"noopener\">MATLAB <\/a>were used in this project.<\/p>\n<p><div style=\"width: 334px\" class=\"wp-caption alignnone\"><a href=\"http:\/\/ichef.bbci.co.uk\/news\/624\/cpsprodpb\/4C41\/production\/_89212591_neural_bypass_inf624.png\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" loading=\"lazy\" src=\"http:\/\/ichef.bbci.co.uk\/news\/624\/cpsprodpb\/4C41\/production\/_89212591_neural_bypass_inf624.png\" width=\"324\" height=\"235\" \/><\/a><p class=\"wp-caption-text\">Image Credit: BBC. Source: Battelle\/Ohio State University<\/p><\/div><\/p>\n<p>This remarkable breakthrough is the result of years of research and a cross-discipline project. Engineers, bioengineers, neuroscientists, and surgeons contributed to the prototype medical system and clinical study.\u00a0The device, called <a href=\"https:\/\/www.battelle.org\/government-offerings\/health\/medical-devices\/neurotechnology\/neurolife-neural-bypass-technology\" target=\"_blank\" rel=\"noopener\">NeuroLife<\/a>, was invented at <a href=\"http:\/\/www.battelle.org\/homepage\" target=\"_blank\" rel=\"noopener\">Battelle Institute<\/a>. The engineers at Battelle worked with physicians and neuroscientists from <a href=\"http:\/\/wexnermedical.osu.edu\/\" target=\"_blank\" rel=\"noopener\">Ohio State University Wexner Medical Center<\/a> to develop the research approach and perform the clinical study.<\/p>\n<p>In 2014, Ohio State surgeons implanted a chip in Ian\u2019s brain. The <a href=\"\/\" target=\"_blank\" rel=\"noopener\">Utah Array chip<\/a>\u00a0from <a title=\"http:\/\/blackrockmicro.com\/?s=matlab (link no longer works)\" target=\"_blank\" rel=\"noopener\">Blackrock Microsystems<\/a>\u00a0consists of 96 microelectrode sensors that record the firing of individual neurons.\u00a0The team used brain imaging to identify and isolate the part of Mr. Burkhart\u2019s brain that controls hand movements. During the surgery, the team repeatedly tested exposed brain tissue to pinpoint the correct location for the chip.<\/p>\n<p>After the surgery, Mr. Burkhart spent hours upon hours watching an avatar of a hand on a screen, concentrating on the thoughts it would take to make the movement.\u00a0 During these sessions, the activity in his brain was recorded and analyzed.\u00a0The goal was to understand which signals in his brain corresponded with the hand movements he was mentally emulating.<\/p>\n<p>The firing patterns in his brain were transmitted to a computer and recorded. The amount of data this requires is immense. Three million samples of neural activity are collected each second. \u00a0Approximately\u00a0one\u00a0gigabyte of data is generated from neurons in the motor cortex\u00a0every three minutes.<\/p>\n<p>The researchers used machine learning\u00a0to decode these patterns. Through repetition, the firing patterns were analyzed and used to develop an algorithm to control the muscles in his hand.\u00a0The algorithm was adjusted after almost every training session. Machine learning aided the\u00a0recalibration as Ian&#8217;s\u00a0mind adjusted to the movement and apparatus.<\/p>\n<h2><strong>How MATLAB was used in this project<\/strong><\/h2>\n<p>From the journal Nature:<\/p>\n<p style=\"padding-left: 30px;\"><span style=\"color: #005695;\">&#8220;The digitized data were then transmitted to a personal computer where they were decoded to determine which motion was being imagined and then encoded to evoke the desired response from the muscles in the forearm. The computer communicated with the custom high-definition neuromuscular electrical stimulator (NMES) that drove the electrode sleeve wrapped around the forearm.<\/span><\/p>\n<p style=\"padding-left: 30px;\"><span style=\"color: #005695;\">&#8220;The <span style=\"text-decoration: underline;\"><a style=\"color: #005695; text-decoration: underline;\" href=\"https:\/\/www.mathworks.com\/products\/signal\/?s_tid=srchtitle\" target=\"_blank\" rel=\"noopener\">signal processing<\/a><\/span> and decoding\/control algorithms were all run on a personal computer using MATLAB. The digitized data from the Neuroport was processed every 100 ms.&#8221;<\/span><\/p>\n<p>The computer decoded the signals from the brain and translated them to specific movements. \u00a0The team used a NMES sleeve that applied electrical stimulus to his hand muscles. \u00a0The sleeve has 130 electrodes that rest on the skin\u2019s surface and transmit signals through Ian\u2019s arm to activate his muscles.<\/p>\n<p>After a year of training, Ian was able to learn through repetition to pour from a bottle, and stir a cup.\u00a0 He was also able to learn to play a guitar video game!<\/p>\n<h2><strong>More work is needed<\/strong><\/h2>\n<ul>\n<li>For starters, the system\u00a0isn\u2019t portable. The Neuroport requires a direct connection to the computer. Additionally, the amount of data produced exceeds current wireless capabilities. To truly enhance independence, a wireless system will be required.<\/li>\n<li>There are also limits to the movements that can be accomplished. The implant only monitors up to 96 of the millions of neurons in the motor cortex. For complex hand movements, people use far more than a hundred neurons. In future studies, the team plans to increase number of electrodes.<\/li>\n<li>The sleeve that transmits electrical pulses to stimulate the muscles in the forearm will likely need to be adjusted as well. The current voltage levels required\u00a0to transmit through the skin can interfere with the signals being recorded in the brain. In the future, researchers may implant the electrodes in the forearm in order to reduce the voltage used.<\/li>\n<\/ul>\n<p>As amazing as the technology is, I have to say that I am equally amazed by the brave man that was willing to dedicate so much of his time and effort in an attempt to further the research and help others. Mr. Burkhart agreed to go through multiple brain surgeries even though he knew the reclaimed mobility would only be temporary. The system only works while he\u2019s at the lab and the chip will be removed later this summer. The hope is to create a system that will be able to help people like Ian gain independence in their everyday life.<\/p>\n<p style=\"padding-left: 30px;\"><strong><span style=\"color: #005695;\"><a style=\"color: #005695;\" href=\"http:\/\/www.nature.com\/news\/first-paralysed-person-to-be-reanimated-offers-neuroscience-insights-1.19749\" target=\"_blank\" rel=\"noopener\">\u201c\u2026even if it\u2019s something I can never take home in my lifetime, I\u2019m glad I\u2019ve had the opportunity to take part in this study&#8230; I know that I\u2019ve done a lot of work to help other people as well,\u201d<\/a> Ian Burkhart said in his interview with Nature.<\/span><\/strong><\/p>\n<p>Kudos, Ian.<\/p>\n","protected":false},"excerpt":{"rendered":"<div class=\"overview-image\"><img decoding=\"async\"  class=\"img-responsive\" src=\"http:\/\/ichef.bbci.co.uk\/news\/624\/cpsprodpb\/4C41\/production\/_89212591_neural_bypass_inf624.png\" onError=\"this.style.display ='none';\" \/><\/div>\n<p>Last week, the New York Times reported the first successful \u201climb reanimation\u201d in a person with quadriplegia. Ian Burkhart, 24, had broken his neck as a teen in a diving accident. His spine was&#8230; <a class=\"read-more\" href=\"https:\/\/blogs.mathworks.com\/headlines\/2016\/04\/20\/neuroscience-and-machine-learning-restore-movement-in-paralyzed-mans-hand\/\">read more >><\/a><\/p>\n","protected":false},"author":138,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/posts\/87"}],"collection":[{"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/users\/138"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/comments?post=87"}],"version-history":[{"count":22,"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/posts\/87\/revisions"}],"predecessor-version":[{"id":3925,"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/posts\/87\/revisions\/3925"}],"wp:attachment":[{"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/media?parent=87"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/categories?post=87"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/tags?post=87"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}