{"id":1444,"date":"2018-04-03T15:11:38","date_gmt":"2018-04-03T15:11:38","guid":{"rendered":"https:\/\/blogs.mathworks.com\/headlines\/?p=1444"},"modified":"2021-09-22T15:22:32","modified_gmt":"2021-09-22T19:22:32","slug":"bug-brain-beats-machine-learning","status":"publish","type":"post","link":"https:\/\/blogs.mathworks.com\/headlines\/2018\/04\/03\/bug-brain-beats-machine-learning\/","title":{"rendered":"Bug Brain Beats Machine Learning"},"content":{"rendered":"<p>Living organisms have long provided inspiration for technology. Biomimicry of birds helped us design our first aircraft, while the structure of seed burs was copied for Velcro. Today, biomimicry is being applied to advanced technology such as <a href=\"http:\/\/news.mit.edu\/2018\/soft-robotic-fish-swims-alongside-real-ones-coral-reefs-0321\" target=\"_blank\" rel=\"noopener\">robotics<\/a> and <a title=\"https:\/\/cosmosmagazine.com\/technology\/visonary-biomimicry-five-insects-inspiring-cutting-edge-technology (link no longer works)\" target=\"_blank\" rel=\"noopener\">computer vision<\/a>.<\/p>\n<p>Another modern-day application of biomimicry is in artificial intelligence (AI).\u00a0 With AI, machines take on natural cognitive functions such as learning and problem-solving. Artificial neural networks (ANNs) take biomimicry a step further by creating computing systems inspired by the brains of living organisms.<\/p>\n<p>But just how intelligent can a system be that is modeled after a relatively unsophisticated biological brain? It turns out, thanks to evolution, even relatively simple brains of living creatures can be very intelligent when it comes to a task that is necessary for their survival. For a moth, that means the sense of smell.<\/p>\n<h2><a href=\"https:\/\/blogs.mathworks.com\/headlines\/2018\/04\/03\/bug-brain-beats-machine-learning\/moth-2\/\" rel=\"attachment wp-att-1454\"><img decoding=\"async\" loading=\"lazy\" class=\"alignnone wp-image-1454 size-medium\" src=\"https:\/\/blogs.mathworks.com\/headlines\/files\/2018\/04\/moth-1-300x200.jpg\" alt=\"Close-up image of moth head.\" width=\"300\" height=\"200\" \/><\/a><\/h2>\n<h2><\/h2>\n<h2>Sometimes, smaller is better<\/h2>\n<p>Even though a moth\u2019s brain is the size of a <a href=\"http:\/\/sciencenordic.com\/moths-get-wind-partner-kilometre-away\" target=\"_blank\" rel=\"noopener\">pinhead<\/a>, it is highly efficient when it comes to learning new odors. Its sense of smell is needed for finding food and finding mates, both critical tasks for their survival as a species.<\/p>\n<p>Researchers from the University of Washington developed a neural network, dubbed MothNet, based on the structure of a moth\u2019s brain.<\/p>\n<blockquote><p>\u201cThe moth olfactory network is among the simplest biological neural systems that can learn,\u201d the researchers, Charles B. Delahunt, Jeffrey Riffell, and J. Nathan Kutz, stated in their paper, <a href=\"https:\/\/arxiv.org\/pdf\/1802.02678.pdf\" target=\"_blank\" rel=\"noopener\">Biological Mechanisms for Learning: A Computational Model of Olfactory Learning in the Manduca sexta Moth, with Applications to Neural Nets.<\/a><\/p><\/blockquote>\n<p>The<em> MIT Technology Review<\/em> article, <a href=\"https:\/\/www.technologyreview.com\/s\/610278\/why-even-a-moths-brain-is-smarter-than-an-ai\/\" target=\"_blank\" rel=\"noopener\">Why even a moth\u2019s brain is smarter than AI<\/a>, described the biological system copied by MothNet, \u201cThe olfactory learning system in moths is relatively simple and well mapped by neuroscientists. It consists of five distinct networks that feed information forward from one to the next.\u201d<\/p>\n<p>&nbsp;<\/p>\n<p><div style=\"width: 361px\" class=\"wp-caption alignnone\"><a href=\"https:\/\/regmedia.co.uk\/2018\/02\/13\/moth_brain_ai.jpg?x=648&amp;y=258&amp;infer_y=1\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" loading=\"lazy\" src=\"https:\/\/regmedia.co.uk\/2018\/02\/13\/moth_brain_ai.jpg?x=648&amp;y=258&amp;infer_y=1\" alt=\"Diagram showing basic he structure of a moth\u2019s brain used to model MothNet.\" width=\"351\" height=\"140\" \/><\/a><p class=\"wp-caption-text\">MothNet was designed to mimic the structure of a moth\u2019s brain. Image credit: Delahunt and Kutz.<\/p><\/div><\/p>\n<p>&nbsp;<\/p>\n<p>Instead of identifying scents, the researchers used supervised learning to train the ANN to recognize handwritten numbers with just 15 to 20 images of each digit from zero to nine. The training samples came from the MNIST (Modified National Institute of Standards and Technology) database of digits commonly used for training and testing in the field of machine learning. Some Examples from the MNIST database are shown below:<\/p>\n<p>&nbsp;<\/p>\n<p><div style=\"width: 360px\" class=\"wp-caption alignnone\"><a href=\"https:\/\/upload.wikimedia.org\/wikipedia\/commons\/2\/27\/MnistExamples.png\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" loading=\"lazy\" src=\"https:\/\/upload.wikimedia.org\/wikipedia\/commons\/2\/27\/MnistExamples.png\" alt=\"Handwritten numbers from a sample of the MINST database.\" width=\"350\" height=\"212\" \/><\/a><p class=\"wp-caption-text\">Sample from the MINST database. Image credit: Wikipedia, CC 4.0.<\/p><\/div><\/p>\n<p>They found MothNet could learn much faster than machines.\u00a0 MothNet \u201clearned\u201d to recognize numbers with just a few training samples with an accuracy of 75 to 85 percent. A typical convolutional neural network, by comparison, requires thousands of training examples to achieve 99% accuracy.<\/p>\n<h2>Developing Better Machine Learning Algorithms<\/h2>\n<p>The researchers found that the moth\u2019s biological system was efficient at learning due to three main characteristics which could aid in the development of new machine learning algorithms:<\/p>\n<ul>\n<li>First, it learned quickly by filtering information at each step and only passing along the most critical information to the next phase is the system. While the first of the five distinct networks starts with nearly 30,000 receptors in the antenna, the second network is comprised of 4,000 cells. By the time the information reaches the last network in the system, the neurons number in the 10s.<\/li>\n<li>Second, the filtering process had the added benefit of removing noise from the signals. The sparse layer between the first two networks acts as an effective noise filter, protecting the downstream neurons from the noisy signal received by the &#8220;antennas&#8221;.<\/li>\n<li>Lastly, the brain \u201crewarded\u201d successfully identifying odors with a release of a chemical neurotransmitter called Octopamine, reinforcing the successful connections in the neural wiring. The active connections strengthen for an assigned digit, the rest wither away.<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<p><div style=\"width: 471px\" class=\"wp-caption alignnone\"><a href=\"https:\/\/cdn.technologyreview.com\/i\/images\/moth-learning.png?sw=600&amp;cx=0&amp;cy=0&amp;cw=780&amp;ch=594\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" loading=\"lazy\" class=\"\" src=\"https:\/\/cdn.technologyreview.com\/i\/images\/moth-learning.png?sw=600&amp;cx=0&amp;cy=0&amp;cw=780&amp;ch=594\" alt=\"\" width=\"461\" height=\"350\" \/><\/a><p class=\"wp-caption-text\">The green lines highlight the pathways in MothNet, the artificial neural network and the blue lines are the biological pathways. Image credit: Delahunt and Kutz.<\/p><\/div><\/p>\n<p>&nbsp;<\/p>\n<blockquote><p>\u201cThe results demonstrate that even very simple biological architectures hold novel and effective algorithmic tools applicable to [machine learning] tasks, in particular, tasks constrained by few training samples or the need to add new classes without full retraining,\u201d the researchers stated in the paper.<\/p><\/blockquote>\n<p>All coding was done in <a href=\"https:\/\/www.mathworks.com\/products\/matlab.html\" target=\"_blank\" rel=\"noopener\">MATLAB<\/a>. The code for this paper can be found <a href=\"https:\/\/github.com\/charlesDelahunt\/SmartAsABug\">here<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<div class=\"overview-image\"><img decoding=\"async\"  class=\"img-responsive\" src=\"https:\/\/blogs.mathworks.com\/headlines\/files\/2018\/04\/moth-1-300x200.jpg\" onError=\"this.style.display ='none';\" \/><\/div>\n<p>Living organisms have long provided inspiration for technology. Biomimicry of birds helped us design our first aircraft, while the structure of seed burs was copied for Velcro. Today, biomimicry is&#8230; <a class=\"read-more\" href=\"https:\/\/blogs.mathworks.com\/headlines\/2018\/04\/03\/bug-brain-beats-machine-learning\/\">read more >><\/a><\/p>\n","protected":false},"author":138,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/posts\/1444"}],"collection":[{"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/users\/138"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/comments?post=1444"}],"version-history":[{"count":10,"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/posts\/1444\/revisions"}],"predecessor-version":[{"id":3276,"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/posts\/1444\/revisions\/3276"}],"wp:attachment":[{"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/media?parent=1444"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/categories?post=1444"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/tags?post=1444"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}