{"id":18968,"date":"2025-11-18T11:56:44","date_gmt":"2025-11-18T16:56:44","guid":{"rendered":"https:\/\/blogs.mathworks.com\/deep-learning\/?p=18968"},"modified":"2025-11-18T11:56:44","modified_gmt":"2025-11-18T16:56:44","slug":"matlab-mcp-core-server-brings-hardware-into-ai-assisted-engineering","status":"publish","type":"post","link":"https:\/\/blogs.mathworks.com\/deep-learning\/2025\/11\/18\/matlab-mcp-core-server-brings-hardware-into-ai-assisted-engineering\/","title":{"rendered":"MATLAB MCP Core Server Brings Hardware into AI-Assisted Engineering"},"content":{"rendered":"<h6><\/h6>\r\n<table style=\"background-color: #e2f0ff;\">\r\n<tbody>\r\n<tr>\r\n<td style=\"width: 120px; padding: 3px; vertical-align: middle;\"><img decoding=\"async\" loading=\"lazy\" class=\"aligncenter wp-image-18969\" src=\"https:\/\/blogs.mathworks.com\/deep-learning\/files\/2025\/11\/jacob.jpg\" alt=\"\" width=\"100\" height=\"100\" \/><\/td>\r\n<td style=\"vertical-align: middle; padding: 3px;\"><strong>Guest Writer: <a href=\"https:\/\/www.linkedin.com\/in\/jacob-george\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Jacob George<\/a><\/strong>\r\n<h6><\/h6>\r\n<a href=\"https:\/\/www.linkedin.com\/in\/jacob-george\">Jacob George<\/a> is the Product Manager for <a href=\"https:\/\/www.mathworks.com\/products\/data-acquisition.html\">Data Acquisition Toolbox<\/a>, <a href=\"https:\/\/www.mathworks.com\/products\/image-acquisition.html\">Image Acquisition Toolbox<\/a>, and <a href=\"https:\/\/thingspeak.mathworks.com\/\">ThingSpeak<\/a>. In this blog post, he discusses MATLAB MCP Core Server and hardware connectivity.<\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\n<h6><\/h6>\r\nLarge language models like ChatGPT or Claude can write MATLAB code, but cannot sense your hardware, read sensor data, understand your hardware constraints, or validate solutions against real-world performance. You were stuck in an isolated conversation of brilliant suggestions but disconnected from reality.\r\n\r\nThe MATLAB MCP Core Server changes this fundamental limitation by making your hardware and data part of the AI's reasoning process.\r\n<h6><\/h6>\r\n<h2>Webcam Face Detection in VS Code<\/h2>\r\nLet me show you what hardware-integrated AI coding looks like in practice using GitHub Copilot in VS Code.\r\n\r\nSay you want to capture an image from your webcam using Image Acquisition Toolbox and detect faces using Computer Vision Toolbox in MATLAB. In a traditional workflow, you would search documentation, write code, test it manually, debug errors, and iterate.\r\n\r\nIn VS Code with Copilot enabled and <a href=\"https:\/\/blogs.mathworks.com\/deep-learning\/2025\/11\/03\/releasing-the-matlab-mcp-core-server-on-github\/\">MATLAB MCP Server configured<\/a>, you could simply ask:\r\n<h6><\/h6>\r\n<em>\"<\/em> <em>Create and run MATLAB code that gets a snapshot from my Logitech Camera (not my integrated camera) using the Image Acquisition Toolbox functions, run face detection on the snapshot and circle the face in blue.\"<\/em>\r\n\r\n&nbsp;\r\n<h6><\/h6>\r\n<div class=\"row\"><div class=\"col-xs-12 containing-block\"><div class=\"bc-outer-container add_margin_20\"><videoplayer><div class=\"video-js-container\"><video data-video-id=\"6385114288112\" data-video-category=\"blog\" data-autostart=\"false\" data-account=\"62009828001\" data-omniture-account=\"mathwgbl\" data-player=\"rJ9XCz2Sx\" data-embed=\"default\" id=\"mathworks-brightcove-player\" class=\"video-js\" controls><\/video><script src=\"\/\/players.brightcove.net\/62009828001\/rJ9XCz2Sx_default\/index.min.js\"><\/script><script>if (typeof(playerLoaded) === 'undefined') {var playerLoaded = false;}(function isVideojsDefined() {if (typeof(videojs) !== 'undefined') {videojs(\"mathworks-brightcove-player\").on('loadedmetadata', function() {playerLoaded = true;});} else {setTimeout(isVideojsDefined, 10);}})();<\/script><\/div><\/videoplayer><\/div><\/div><\/div>\r\n<h6><\/h6>\r\nCopilot does not just write code; it uses the MCP server to execute it directly in your MATLAB environment and accesses your actual webcam hardware using the Image Acquisition Toolbox. This was 0 to 1 in just 2.5 minutes!\r\n<h6><\/h6>\r\n<h2>The Real Problem with Current AI Workflows<\/h2>\r\nHere is what engineers experience today: An AI chat suggests an algorithm for signal processing. You copy it and run it elsewhere. It crashes because calibration data from your specific sensor does not match the example assumptions. You describe the error back to the AI. It suggests a fix. Repeat ten times. By the time you have debugged the code, you have lost momentum and the AI's context feels stale.\r\n\r\nBut there is a deeper issue. Engineers don't just write code, they run it against real hardware, watch it fail in interesting ways, and use those failures to refine their understanding. Traditional LLM cannot do that. It cannot access your Arduino data stream and update the GPIO pins. It cannot connect to your oscilloscope, configure trigger levels, and iterate based on real measurements. The MATLAB <a href=\"https:\/\/www.mathworks.com\/solutions\/test-measurement.html\">Test and Measurement<\/a> products with MATLAB MCP enable these workflows.\r\n<h6><\/h6>\r\n<img decoding=\"async\" loading=\"lazy\" class=\"aligncenter wp-image-18973\" src=\"https:\/\/blogs.mathworks.com\/deep-learning\/files\/2025\/11\/MATLAB-MCP-and-Webcam.png\" alt=\"\" width=\"800\" height=\"448\" \/>\r\n<h6><\/h6>\r\n<h2>Conclusion<\/h2>\r\nThe MATLAB MCP Core Server represents a fundamental shift in hardware-assisted development. Rather than AI being separate from your hardware systems, it becomes an integrated participant in the development process.\r\n\r\nFor engineers building IoT systems, sensor networks, embedded controls, and hardware-connected applications, this is the missing link that makes AI-assisted development truly practical. Feedback loops with actual hardware and rapid iteration cycles transform how quickly you can prototype and deploy.\r\n\r\nThe future of engineering with AI is not about better code suggestions. It is about integrated intelligence that sees what your hardware sees, runs what you build, measures what happens, and iterates alongside you.","protected":false},"excerpt":{"rendered":"<div class=\"overview-image\"><img src=\"https:\/\/blogs.mathworks.com\/deep-learning\/files\/2025\/11\/MATLAB-MCP-and-Webcam.png\" class=\"img-responsive attachment-post-thumbnail size-post-thumbnail wp-post-image\" alt=\"\" decoding=\"async\" loading=\"lazy\" \/><\/div><p>\r\n\r\n\r\n\r\n\r\nGuest Writer: Jacob George\r\n\r\nJacob George is the Product Manager for Data Acquisition Toolbox, Image Acquisition Toolbox, and ThingSpeak. In this blog post, he discusses MATLAB MCP Core... <a class=\"read-more\" href=\"https:\/\/blogs.mathworks.com\/deep-learning\/2025\/11\/18\/matlab-mcp-core-server-brings-hardware-into-ai-assisted-engineering\/\">read more >><\/a><\/p>","protected":false},"author":230,"featured_media":18973,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[74,75],"tags":[],"_links":{"self":[{"href":"https:\/\/blogs.mathworks.com\/deep-learning\/wp-json\/wp\/v2\/posts\/18968"}],"collection":[{"href":"https:\/\/blogs.mathworks.com\/deep-learning\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.mathworks.com\/deep-learning\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.mathworks.com\/deep-learning\/wp-json\/wp\/v2\/users\/230"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.mathworks.com\/deep-learning\/wp-json\/wp\/v2\/comments?post=18968"}],"version-history":[{"count":5,"href":"https:\/\/blogs.mathworks.com\/deep-learning\/wp-json\/wp\/v2\/posts\/18968\/revisions"}],"predecessor-version":[{"id":18975,"href":"https:\/\/blogs.mathworks.com\/deep-learning\/wp-json\/wp\/v2\/posts\/18968\/revisions\/18975"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blogs.mathworks.com\/deep-learning\/wp-json\/wp\/v2\/media\/18973"}],"wp:attachment":[{"href":"https:\/\/blogs.mathworks.com\/deep-learning\/wp-json\/wp\/v2\/media?parent=18968"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.mathworks.com\/deep-learning\/wp-json\/wp\/v2\/categories?post=18968"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.mathworks.com\/deep-learning\/wp-json\/wp\/v2\/tags?post=18968"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}