{"id":1553,"date":"2018-05-14T20:49:39","date_gmt":"2018-05-14T20:49:39","guid":{"rendered":"https:\/\/blogs.mathworks.com\/headlines\/?p=1553"},"modified":"2018-10-30T20:29:20","modified_gmt":"2018-10-30T20:29:20","slug":"a-praying-mantis-could-teach-robots-a-thing-or-two-about-3d-machine-vision","status":"publish","type":"post","link":"https:\/\/blogs.mathworks.com\/headlines\/2018\/05\/14\/a-praying-mantis-could-teach-robots-a-thing-or-two-about-3d-machine-vision\/","title":{"rendered":"A praying mantis could teach robots a thing or two about 3D machine vision"},"content":{"rendered":"

What\u2019s the best way to teach a robot or drone to see in 3D? Quite possibly, the answer is to teach it to think like an insect. A praying mantis, to be more specific.<\/p>\n

A team at the Institute of Neuroscience at Newcastle University recently studied the stereoscopic vision of the praying mantis and found that its approach to depth perception is quite different than ours. It\u2019s much more computationally efficient.<\/p>\n

And what do you need to study praying mantises’ 3D vision? 3D glasses, of course!<\/p>\n

 <\/p>\n

\"Praying<\/a>

Image Credit: Newcastle University<\/p><\/div><\/p>\n

 <\/p>\n

The team, led by behavioral ecologist Dr. Vivek Nityananda, discovered that mantis 3D vision works differently from all previously known forms of biological 3D vision. Mammals, birds, and amphibians with stereo vision compute the slight differences in the images seen by their right and left eye. These differences determine the objects\u2019 positions in 3D, providing the person or animal with depth perception. Then they tested mantises\u2019 3D vision.<\/p>\n

\u201cThe researchers tested the mantises vision by simulating prey on a screen. The tests mirrored those carried out to investigate human 3D vision. The images on the screen, seen without the glasses, look like the familiar fuzzy bi-colored images you see when you accidentally stumble into a theater featuring a movie in 3D,\u201d per the ZDNet<\/em> article, A praying mantis wearing tiny glasses holds the key to robot vision<\/a>. \u00a0<\/strong>\u201cWhat the researchers found was that the mantis only see objects in 3D when they’re moving.\u201d<\/p><\/blockquote>\n

Publishing their latest research in\u00a0Current Biology<\/a><\/em>, the research showed the insects don\u2019t process the details in the image. They simply look for areas where the image is changing. By focusing on movement alone, mantises target their prey.<\/p>\n

\u201cThis is a completely new form of 3D vision as it is based on change over time instead of static images,\u201d said Nityananda. \u201cIn mantises, it is probably designed to answer the question \u2018is there prey at the right distance for me to catch?\u2019\u201d<\/p><\/blockquote>\n

They also use a lot less \u201ccomputing power\u201d than a human would analyzing the same scene. Given the much smaller size of their brains, the reduced computing requirements are necessary. They have less than 1 million neurons to a human\u2019s 85 billion. But in some ways, their stereovision is more capable than ours.<\/p>\n

\u201cEven if we made the two eyes\u2019 images completely different, mantises can still match up the places where things are changing,\u201d stated Nityananda, \u201ceven though humans can\u2019t.\u201d<\/p><\/blockquote>\n

The research<\/h2>\n

The researchers created a mantis movie that gave the illusion of prey hovering right in front of the mantis. The mantis would try to catch the prey.<\/p>\n

Then they attached special insect 3D glasses, temporarily glued to the mantis with beeswax. With the different colored filters, the researchers could project a different image to each eye. When the two images were combined, it created the illusion of depth.<\/p>\n

 <\/p>\n

<\/a>

Image Credit: Current Biology<\/em> article submitted by Newcastle University.<\/p><\/div><\/p>\n

 <\/p>\n

In the above image, the targets in the left and right image move until they converge at the appropriate perceived depth. This triggered the mantis’ strike.<\/p>\n

\u201cThey played variations on the same film: a target dot that moved against a polka-dot background.\u00a0The target dot and its 3-D motion were so convincing that the mantises attacked, like a cat hunting a laser pointer,\u201d per The Washington Post<\/a><\/em>.<\/p><\/blockquote>\n

All stimuli were custom written in MATLAB<\/a> with the Psychophysics Toolbox<\/a>. Here\u2019s a human version of the stimulus, rendered in red and blue. For the experiment, the video was rendered in blue and green to be visible to the mantis. Source: Newcastle University.<\/p>\n

\nhttps:\/\/ars.els-cdn.com\/content\/image\/1-s2.0-S0960982218300149-mmc2.mp4<\/a><\/video><\/div><\/p>\n","protected":false},"excerpt":{"rendered":"
<\/div>\n

What\u2019s the best way to teach a robot or drone to see in 3D? Quite possibly, the answer is to teach it to think like an insect. A praying mantis, to be more specific.
\nA team at the Institute of… read more >><\/a><\/p>\n","protected":false},"author":138,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/posts\/1553"}],"collection":[{"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/users\/138"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/comments?post=1553"}],"version-history":[{"count":6,"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/posts\/1553\/revisions"}],"predecessor-version":[{"id":1988,"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/posts\/1553\/revisions\/1988"}],"wp:attachment":[{"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/media?parent=1553"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/categories?post=1553"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.mathworks.com\/headlines\/wp-json\/wp\/v2\/tags?post=1553"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}