{"id":2342,"date":"2019-08-29T17:30:58","date_gmt":"2019-08-29T17:30:58","guid":{"rendered":"https:\/\/blogs.mathworks.com\/headlines\/?p=2342"},"modified":"2019-08-29T17:30:58","modified_gmt":"2019-08-29T17:30:58","slug":"mind-controlled-robot-that-works-without-brain-implants","status":"publish","type":"post","link":"https:\/\/blogs.mathworks.com\/headlines\/2019\/08\/29\/mind-controlled-robot-that-works-without-brain-implants\/","title":{"rendered":"Mind-controlled robot that works without brain implants"},"content":{"rendered":"<p>Mind-controlled robots have long been featured in science fiction, but thanks to new research in brain-computer interfaces (BCIs), they are no longer fiction.<\/p>\n<p>BCIs are enabling thought-controlled external devices. BCIs are communication pathways between the brain and an external device that translate a person\u2019s brain activity into a signal that controls the external device, such as a robot.<\/p>\n<p><div style=\"width: 381px\" class=\"wp-caption alignnone\"><a href=\"https:\/\/www.cmu.edu\/news\/stories\/archives\/2019\/june\/images\/mind-controlled-robotic-arm-900x600.jpg\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" loading=\"lazy\" class=\"\" src=\"https:\/\/www.cmu.edu\/news\/stories\/archives\/2019\/june\/images\/mind-controlled-robotic-arm-900x600.jpg\" width=\"371\" height=\"248\" \/><\/a><p class=\"wp-caption-text\">A non-invasive brain-computer interface (BCI). Image credit: Carnegie Mellon University<\/p><\/div><\/p>\n<p>&nbsp;<\/p>\n<p>Researchers have been working on BCIs for quite some time, and they&#8217;ve delivered impressive results. In 2016, Battelle demonstrated the <a href=\"https:\/\/blogs.mathworks.com\/headlines\/2016\/04\/20\/neuroscience-and-machine-learning-restore-movement-in-paralyzed-mans-hand\/\" target=\"_blank\" rel=\"noopener\">NeuroLife device<\/a> which used machine learning, a sleeve of electrodes to stimulate selective muscles in the arm, and a chip implanted in the brain to enable a paralyzed man move his own arm. In 2014, researchers from Johns Hopkins Applied Physics Laboratory created mind-controlled\u00a0<a href=\"https:\/\/www.businessinsider.com\/les-baugh-is-the-first-person-with-two-mind-controlled-robotic-arms-2014-12\" target=\"_blank\" rel=\"noopener\">robotic prosthetics<\/a> for a double amputee. In this case, a targeted muscle innervation surgery reassigned nerves that once controlled the patient\u2019s arm and hand, enabling the nerves to control the prosthetic devices.<\/p>\n<p>These breakthroughs have the potential to greatly improve the lives of paralysis patients and amputees. But these systems are specialized for each patient and the procedures are highly-invasive. What both of these amazing feats of engineering and science have in common is that they required the patient to undergo surgery. Every surgery has associated risks and is potentially dangerous to the patient.<\/p>\n<p>Steps are also being taken to reduce the surgical intervention required. Elon Musk&#8217;s company, Neuralink, is working on a less-invasive BCI which replaces chips in the brain with &#8220;threads&#8221;. He shared some of the details behind the proposed system, including a sewing-machine like a robot that would insert the threads into the patient&#8217;s brain.<\/p>\n<p>For now, surgery would still be required. According to <a href=\"https:\/\/www.nytimes.com\/2019\/07\/16\/technology\/neuralink-elon-musk.html\" target=\"_blank\" rel=\"noopener\"><em>The New York Times<\/em><\/a>, &#8220;The company says surgeons would have to drill holes through the skull to implant the threads. But in the future, they hope to use a laser beam to pierce the skull with a series of tiny holes.&#8221;<\/p>\n<p><div style=\"width: 363px\" class=\"wp-caption alignnone\"><a href=\"https:\/\/static01.nyt.com\/images\/2019\/07\/16\/arts\/16neuralink1\/16neuralink1-superJumbo.jpg?quality=90&amp;auto=webp\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" loading=\"lazy\" class=\"\" src=\"https:\/\/static01.nyt.com\/images\/2019\/07\/16\/arts\/16neuralink1\/16neuralink1-superJumbo.jpg?quality=90&amp;auto=webp\" width=\"353\" height=\"236\" \/><\/a><p class=\"wp-caption-text\">Neuralink&#8217;s system would utilize a small computer behind the ear. The computer would be attached to small wires that extend into the brain. Image credit: Neuralink.<\/p><\/div><\/p>\n<p>&nbsp;<\/p>\n<h2>Non-invasive BCI<\/h2>\n<p>Non-invasive techniques have been developed, but only provided limited control of the external devices, typically a robot. The systems couldn\u2019t access enough of the brain\u2019s signals to offer reliable operation. Now, researchers from Carnegie Mellon University (CMU) and the University of Minnesota have developed a non-invasive BCI system that smoothly controls a robotic arm in real-time.<\/p>\n<p>According to <a href=\"https:\/\/www.design-engineering.com\/researchers-boost-precision-of-robotic-arm-controlled-without-brain-implants-1004033359\/\" target=\"_blank\" rel=\"noopener\"><em>Design Engineering<\/em><\/a>, \u201cBCIs without brain implants are less complicated and dangerous to install but typically produce sloppier control. The Carnegie Mellon team says the enhanced accuracy and responsiveness of their non-invasive system could hold great promise for paralyzed patients or those with severe motor limitations.\u201d<\/p>\n<p>The team recently published their research in <em><a href=\"https:\/\/robotics.sciencemag.org\/content\/4\/31\/eaaw6844\" target=\"_blank\" rel=\"noopener\">Science Robotics<\/a><\/em>.<\/p>\n<h2>Smooth operator!<\/h2>\n<p>In order to achieve smooth operation of the robotic arm, the BCI must be able to reliably read (sense) and decode sufficient neural signals from the patient. The CMU team used electroencephalography (EEG) as a sensing method: The study participants wore a cap that monitored their EEG signals.<\/p>\n<p><div style=\"width: 411px\" class=\"wp-caption alignnone\"><a href=\"https:\/\/techcrunch.com\/wp-content\/uploads\/2019\/06\/bci-cmu-robot-arm.gif?w=1390&amp;crop=1\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" loading=\"lazy\" class=\"\" src=\"https:\/\/techcrunch.com\/wp-content\/uploads\/2019\/06\/bci-cmu-robot-arm.gif?w=1390&amp;crop=1\" width=\"401\" height=\"221\" \/><\/a><p class=\"wp-caption-text\">Image credit: Carnegie Mellon University<\/p><\/div><\/p>\n<p>&nbsp;<\/p>\n<p>For the \u201cbrain\u201d side of the BCI equation, they trained 33 able-bodied participants with the system for the study. For the \u201ccomputer\u201d side, the team utilized machine learning to account for differences in each participants&#8217; skill level.<\/p>\n<p>Decoding the EEG signals was key to the study\u2019s success. The team used electrical source imaging (ESI), a technique that uses the electrical proportions and geometry of each participant\u2019s head. For ESI, the MATLAB-based\u00a0Brainstorm\u00a0toolbox (available for download\u00a0<a href=\"https:\/\/www.mathworks.com\/matlabcentral\/fileexchange\/64589-brainstorm?s_tid=srchtitle\" target=\"_blank\" rel=\"noopener\">here<\/a>) used the MRI data from each participant along with the EEG electrode locations to improve the neural decoding.\u00a0The signal processing was then completed with custom\u00a0<a href=\"https:\/\/www.mathworks.com\/products\/matlab.html\" target=\"_blank\" rel=\"noopener\">MATLAB<\/a>\u00a0scripts.<\/p>\n<p>According to the published study, \u201cDramatic improvements in offline neural decoding have been observed when using ESI compared with traditional sensor techniques.\u201d<\/p>\n<p>MATLAB was also used for the statistical analysis in the study. And the results were impressive! The team\u2019s unique approach to solving this problem not only enhanced BCI learning by nearly 60%, it also enhanced continuous tracking of the computer cursor by over 500%.<\/p>\n<p>\u201cDespite technical challenges using noninvasive signals, we are fully committed to bringing this safe and economic technology to people who can benefit from it,\u201d Bin He, lead researcher for this study and head of the\u00a0Biomedical Engineering Department\u00a0at Carnegie Mellon, said. \u201cThis work represents an important step in noninvasive brain-computer interfaces, a technology that someday may become a pervasive assistive technology aiding everyone, like smartphones.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"<div class=\"overview-image\"><img decoding=\"async\"  class=\"img-responsive\" src=\"https:\/\/www.cmu.edu\/news\/stories\/archives\/2019\/june\/images\/mind-controlled-robotic-arm-900x600.jpg\" onError=\"this.style.display ='none';\" \/><\/div>\n<p>Mind-controlled robots have long been featured in science fiction, but thanks to new research in brain-computer interfaces (BCIs), they are no longer fiction.<br \/>\nBCIs are enabling thought-controlled&#8230; <a class=\"read-more\" href=\"https:\/\/blogs.mathworks.com\/headlines\/2019\/08\/29\/mind-controlled-robot-that-works-without-brain-implants\/\">read more >><\/a><\/p>\n","protected":false},"author":138,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/posts\/2342"}],"collection":[{"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/users\/138"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/comments?post=2342"}],"version-history":[{"count":3,"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/posts\/2342\/revisions"}],"predecessor-version":[{"id":2354,"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/posts\/2342\/revisions\/2354"}],"wp:attachment":[{"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/media?parent=2342"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/categories?post=2342"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/tags?post=2342"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}