{"id":4319,"date":"2026-06-15T05:46:47","date_gmt":"2026-06-15T09:46:47","guid":{"rendered":"https:\/\/blogs.mathworks.com\/matlab\/?p=4319"},"modified":"2026-06-15T05:48:19","modified_gmt":"2026-06-15T09:48:19","slug":"running-local-agentic-ai-workflows-with-matlab-on-a-16gb-macbook-pro-with-lm-studio-and-gemma-4","status":"publish","type":"post","link":"https:\/\/blogs.mathworks.com\/matlab\/2026\/06\/15\/running-local-agentic-ai-workflows-with-matlab-on-a-16gb-macbook-pro-with-lm-studio-and-gemma-4\/","title":{"rendered":"Running local Agentic AI workflows with MATLAB on a 16Gb Macbook Pro with LM Studio and gemma 4"},"content":{"rendered":"
Back in January, I <\/span>showed how put a 120 billion parameter LLM on a 128Gb NVIDIA DGX Spark and hook it up to MATLAB<\/span><\/a>. My colleague, Abhijit Bhattacharjee quickly followed up with an article <\/span>showing how to use the same model and hardware agentically using OpenCode and MATLAB MCP Server<\/span><\/a>.<\/span><\/div>
These articles resulted in a lot of interest from users who wanted to start playing with local agentic AI. The only problem is that most people don't have access to machines with 128GB of VRAM or unified memory. I certainly don't most of the time. Indeed, I had to borrow the NVIDIA DGX Spark from my friend Nick to research and write my articles about it. <\/span><\/div>
Most of the time I use much more modest machines such as the 16Gb M2 Macbook Pro I am writing this article on. Turns out, that's enough to get started.<\/span><\/div>

Installing a local AI model on your machine<\/span><\/h2>
There are several ways to do this but I think that the easiest way to start is to download and install <\/span>LM Studio<\/span><\/a>. It provides a graphical user interface and you can go from install to chatting with an AI model in just a few minutes.<\/span><\/div>
After LM Studio has been installed, use the Model search to choose a suitable model. For the purposes of this article, I used the original gguf version of the brand new <\/span>gemma-4-12b model<\/span><\/a>. As a general rule, you'll want to try to find <\/span>mlx versions<\/span><\/a> of models on a Mac because they have been especially tuned for Mac hardware and so will probably run faster than the equivalent gguf model. <\/span><\/div>
There's nothing wrong with using a gguf model on a Mac though and it just happened to be what I started out with. LM Studio does a good job with these models since it makes use of llama.cpp under the hood.<\/span><\/div>
\"\"<\/img><\/div>
Whatever model you end up using, just make sure that 'Tool use' is listed as one of its capabilities or you'll not be able to use it agentically.<\/span><\/div>
Once you have your model downloaded, all you need to do now is select and start chatting with it.<\/span><\/div>
\"\"<\/img><\/div>

Increasing the context length<\/span><\/h2>
This is vitally important! By default, the AI only has a context length of 4096 tokens set up in LM Studio which is nowhere near enough for agentic workflows so we need to increase it. I originally doubled it but various sources online suggested that it should be around 32,000 or so. The model we are using supports context lengths up to 262144 but I was worried that I wouldn't have enough memory to support this and need to do more experimentation. <\/span><\/div>
\"\"<\/img><\/div>
If you don't do this step, the AI will seem to have the memory of a goldfish and will lose track of what its supposed to be doing in the middle of its work.<\/span><\/div>

Setting up MATLAB and filesystem MCP servers in LM Studio<\/span><\/h2>
At this point, your model can chat with you but it can\u2019t do much else. It can\u2019t read or write files on your machine, for example, and it can\u2019t directly interact with MATLAB. If you ask it to write MATLAB code, it will do so in the chat window and then suggest that you copy and paste it to your machine.<\/span><\/div>
\"\"<\/img><\/div>
Whilst this is fine, it means that we can't take advantage of everything that working agentically would give us. For example, if the AI hallucinates some MATLAB code then you, as the human in the loop, will be the one that has to tell it as you painfully copy and paste code and error messages between MATLAB and the AI. This gets old fast!<\/span><\/div>
To allow the AI to work agenitcally, it needs to be able to read and write files on your machine and also to directly interact with MATLAB. To do these things, we need to install MCP servers. I installed two, the <\/span>Filesystem MCP Server<\/span><\/a> and the <\/span>MATLAB MCP Server<\/span><\/a>. <\/span><\/div>
The Filesystem MCP Server<\/span><\/div>
To install the Filesystem MCP Server, I ran the following command in the Mac OS Terminal.<\/span><\/div>
sudo npm install -g @modelcontextprotocol\/server-filesystem<\/span><\/span><\/div><\/div>
If you don\u2019t have the npm command available then you\u2019ll need to install Node.js. I did that by <\/span>getting it from Nodejs.org<\/span><\/a>.<\/span><\/div>
The MATLAB MCP Server<\/span><\/div>
To install the MATLAB MCP Server, I used the <\/span>MATLAB Agentic toolkit<\/span><\/a> but you can just <\/span>download the binary directly<\/span><\/a> if you wish. Either way, you need to know the path to the file <\/span>matlab-mcp-core-server<\/span><\/div>
Setting up the mcp.json file<\/span><\/div>
\"\"<\/img><\/div>
We now need to tell LM Studio about the MCP Servers. In the developer tab of LMStudio, click on <\/span>mcp.json<\/span>. Here's my version of this file. It assumes that<\/span><\/div>
  • MATLAB MCP Sever is installed at <\/span>\/Users\/mcrouche\/.matlab\/agentic-toolkits\/bin\/matlab-mcp-core-server<\/span><\/li>
  • My MATLAB is installed at <\/span>\/Applications\/MATLAB_R2026a.app\"<\/span><\/li>
  • I've created a working folder called <\/span>\/Users\/mcrouche\/localSandbox\/<\/span> and this is the only folder that the filesystem MCP is allowed to access<\/span><\/li><\/ul>
    {<\/span><\/span><\/div>
    \"mcpServers\": {<\/span><\/span><\/div>
    \"matlab\": {<\/span><\/span><\/div>
    \"command\": \"\/Users\/mcrouche\/.matlab\/agentic-toolkits\/bin\/matlab-mcp-core-server\",<\/span><\/span><\/div>
    \"args\": [<\/span><\/span><\/div>
    \"--matlab-root=\/Applications\/MATLAB_R2026a.app\",<\/span><\/span><\/div>
    \"--initial-working-folder=\/Users\/mcrouche\/localSandbox\",<\/span><\/span><\/div>
    \"--matlab-session-mode=auto\",<\/span><\/span><\/div>
    <\/span><\/span><\/div>
    ]<\/span><\/span><\/div>
    },<\/span><\/span><\/div>
    \"filesystem\": {<\/span><\/span><\/div>
    \"command\": \"\/usr\/local\/bin\/node\",<\/span><\/span><\/div>
    \"args\": [<\/span><\/span><\/div>
    \"\/usr\/local\/lib\/node_modules\/@modelcontextprotocol\/server-filesystem\/dist\/index.js\",<\/span><\/span><\/div>
    \"\/Users\/mcrouche\/localSandbox\"<\/span><\/span><\/div>
    ]<\/span><\/span><\/div>
    }<\/span><\/span><\/div>
    }<\/span><\/span><\/div>
    }<\/span><\/span><\/div><\/div>

    \"\"<\/img><\/h2>
    Once you have your <\/span>mcp.json<\/span> loaded, you should be able to activate the MCP tools. Go back to the chat window, click on Integrations and activate the MCP servers as I do in the animation below<\/span><\/div>
    \"\"<\/img><\/div>

    Running a test prompt<\/span><\/h2>
    All that remains is to run a test prompt to see if everything works properly. Nothing fancy! It just needs to show that all of the tools are working. Here's the prompt I used. <\/span><\/div>
    Write, test and run a MATLAB script that generates and plots a sine wave. Put the script at \/Users\/mcrouche\/localSandbox<\/span><\/div>
    I've learned that I need to be rather more specific than I would be with frontier, cloud-based models. For example, if I don't explicitly tell the model to put the script at in my sandbox (<\/span>\/Users\/mcrouche\/localSandbox)<\/span>, it spends quite some time trying and failing to write it in various other places which wastes both time and context length.<\/span><\/div>