{"id":3152,"date":"2025-02-04T08:47:38","date_gmt":"2025-02-04T13:47:38","guid":{"rendered":"https:\/\/blogs.mathworks.com\/matlab\/?p=3152"},"modified":"2025-02-04T08:47:38","modified_gmt":"2025-02-04T13:47:38","slug":"how-to-run-local-deepseek-models-and-use-them-with-matlab","status":"publish","type":"post","link":"https:\/\/blogs.mathworks.com\/matlab\/2025\/02\/04\/how-to-run-local-deepseek-models-and-use-them-with-matlab\/","title":{"rendered":"How to run local DeepSeek models and use them with MATLAB"},"content":{"rendered":"
Almost immediately after the <\/span>DeepSeek-R1 AI models<\/span><\/a> were made available to the world, people started asking how you can use them in MATLAB. Late last week, Vasileios Papanastasiou, a software test engineer at MathWorks, <\/span>posted how to do this on LinkedIn<\/span><\/a> and this morning I tried out his instructions for the first time on my own machine.<\/span><\/div>

Running deepseek-r1:1.5b on my local machine<\/span><\/h2>
I am going to make use of the \"Large Language Models (LLMS) with MATLAB\" add-on along with ollama to run one of the smaller deepseek models on my local machine and interact with it in MATLAB. Following Vasileios's instructions, the first thing I did was<\/span><\/div>
Download and install Ollama: <\/span>https:\/\/ollama.com\/download<\/span><\/a><\/div>
I did this on Windows. As soon as the installation was complete, I opened up an operating system command line and ran the command<\/span><\/div>
ollama run deepseek-r1:1.5b<\/span><\/span><\/div><\/div>
This installs a 1.5 billion parameter model, which is pretty small but hopefully means that I don't need to worry about computational resource constraints. I can always try larger models later.<\/span><\/div>
\"\"<\/img><\/div>
Now, over to MATLAB. Vasileios suggested that we get the \"Large Language Models (LLMS) with MATLAB\" add-on <\/span>from GitHub<\/span><\/a> but I took a different route. I clicked on Add-ons in the Environment tab of MATLAB R2024b<\/span><\/div>
\"\"<\/img><\/div>
From the Add-on explorer, I searched for 'Large Language Models' and when I found it clicked on 'Add'. This took care of download and installation.<\/span><\/div>
\"\"<\/img><\/div>
That takes care of installation. Let's start playing with it in MATLAB. First, let's create an <\/span>ollamaChat<\/span> object<\/span><\/div>
chat = ollamaChat(<\/span>\"deepseek-r1:1.5b\"<\/span>)<\/span><\/span><\/div><\/div><\/div>
chat = <\/span><\/span><\/div>
 <\/div>
ollamaChat with properties:<\/span><\/span><\/div>
 <\/div>
ModelName: \"deepseek-r1:1.5b\"<\/span><\/span><\/div>
Endpoint: \"127.0.0.1:11434\"<\/span><\/span><\/div>
TopK: Inf<\/span><\/span><\/div>
MinP: 0<\/span><\/span><\/div>
TailFreeSamplingZ: 1<\/span><\/span><\/div>
Temperature: 1<\/span><\/span><\/div>
TopP: 1<\/span><\/span><\/div>
StopSequences: [0\u00d70 string]<\/span><\/span><\/div>
TimeOut: 120<\/span><\/span><\/div>
SystemPrompt: []<\/span><\/span><\/div>
ResponseFormat: \"text\"<\/span><\/span><\/div><\/div>
<\/span><\/div>
Finally, we can try talking to the AI<\/span><\/div>
txt = generate(chat,<\/span>\"What is the speed of light?\"<\/span>)<\/span><\/span><\/div><\/div><\/div>
txt = <\/span><\/span><\/div>
\"<think><\/span><\/span><\/div>
<\/span><\/span><\/div>
<\/think><\/span><\/span><\/div>
<\/span><\/span><\/div>
The exact value of the speed of light in a vacuum is defined as \\( 299,792,458 \\) meters per second. <\/span><\/span><\/div>
This precise definition ensures consistency and accuracy across all scientific measurements and calculations.\"<\/span><\/span><\/div><\/div>
<\/span><\/div>
Something I find fun about LLM models like this is that you can ask the same question over and over again and get a different answer each time which reflects the stochastic nature of them. Sometimes the result is just a little different<\/span><\/div>
txt = generate(chat,<\/span>\"What is the speed of light?\"<\/span>)<\/span><\/span><\/div><\/div><\/div>
txt = <\/span><\/span><\/div>
 <\/div>
\"<think><\/span><\/span><\/div>
<\/span><\/span><\/div>
<\/think><\/span><\/span><\/div>
<\/span><\/span><\/div>
The speed of light in a vacuum is approximately 299,792 kilometers (186,282 statute miles) per second. <\/span><\/span><\/div>
Light is the fastest thing in the universe with its universal speed limit.\"<\/span><\/span><\/div><\/div>
and other times it is very wordy indeed with a lot of 'thinking'.<\/span><\/div>
txt = generate(chat,<\/span>\"What is the speed of light?\"<\/span>)<\/span><\/span><\/div><\/div><\/div>
txt = <\/span><\/span><\/div>
 <\/div>
\"<think><\/span><\/span><\/div>
Okay, so I'm trying to figure out what the speed of light is. I've heard it's something really important in physics, <\/span><\/span><\/div>
especially with relativity and electromagnetism. <\/span><\/span><\/div>
Let me see... I remember that it's called c, but exactly how much is it?<\/span><\/span><\/div>
<\/span><\/span><\/div>
First, I think about units. The speed should be in meters per second because [there's a big unit for that out there. ' ...<\/span><\/span><\/div>
Maybe like 3 times something\u2014maybe 299 million something? Oh, yeah, the original value was 299,792,458 meters per second. <\/span><\/span><\/div>
That seems familiar. Wait, isn't that what it is now?<\/span><\/span><\/div>
<\/span><\/span><\/div>
But I should check if this number makes sense. Why is it so high compared to the speed of trains or planes? <\/span><\/span><\/div>
Because light is such a fast thing, traveling through space at around 300 million meters each second<\/span><\/span><\/div>
\u2014it's way faster than anything else on Earth.<\/span><\/span><\/div>
<\/span><\/span><\/div>
I also recall units in different systems. [It's not just SI, am I right? Maybe another one. <\/span><\/span><\/div>
Wait, in cgs units, which are centimeters and grams, the speed would probably be something times a billion or so cm per second. <\/span><\/span><\/div>
But that seems less relevant now.<\/span><\/span><\/div>
<\/span><\/span><\/div>
Now, how was this value first determined? I think it came out of [Maxwell's equations when considering the speed at which <\/span><\/span><\/div>
electric and magnetic fields propagate through space without any medium\u2014so in a vacuum.<\/span><\/span><\/div>
That must have been quite a theoretical push by scientists. <\/span><\/span><\/div>
Einstein later connected this to special relativity when he needed a way for electrons to accelerate without contradictions.<\/span><\/span><\/div>
<\/span><\/span><\/div>
In everyday terms, c tells us how quickly signals like light or radio waves can move across the universe. <\/span><\/span><\/div>
Without it being so fast, life would be very different, especially in astronomy where such vast distances are covered quickly. <\/span><\/span><\/div>
It's like something almost instantaneous but still moving at a significant pace due to its high value.<\/span><\/span><\/div>
<\/span><\/span><\/div>
But wait, is there any way it could change? Is it constant or does light slow down in some circumstances? <\/span><\/span><\/div>
I haven't heard of the speed of light changing so far.<\/span><\/span><\/div>
Maybe in extreme conditions, like near superconductors or high temperatures, materials might influence [vacuum']s properties, <\/span><\/span><\/div>
affecting how light travels through them.<\/span><\/span><\/div>
But most physicists today would say c is a fundamental, unchanging constant.<\/span><\/span><\/div>
<\/span><\/span><\/div>
I also remember that special relativity deals with how different observers measure time and space when they move relative to each other. <\/span><\/span><\/div>
Light speed being invariant means all observers agree on its value regardless of their motion relative to the light, <\/span><\/span><\/div>
which helps unify space and time into spacetime.<\/span><\/span><\/div>
<\/span><\/span><\/div>
So putting it all together: c is 299,792,458 meters per second precisely\u2014I should check if that's accurate. <\/span><\/span><\/div>
Maybe I've heard it rounded up or kept more decimal places. <\/span><\/span><\/div>
Oh yeah, sometimes calculations round it to about 300 million m\/s for simplicity, but the correct value has all those digits.<\/span><\/span><\/div>
<\/span><\/span><\/div>
I think c is crucial in so many areas like time dilation and the structure of space-time from general relativity. <\/span><\/span><\/div>
It's the cornerstone we use to solve problems in physics whenever a high-speed scenario comes into play without any medium <\/span><\/span><\/div>
to slow things down. Without it being that fast, it wouldn't be as impactful or as something we can use in equations.<\/span><\/span><\/div>
<\/span><\/span><\/div>
So just recapitulating: The speed of light is approximately three times 10^8 meters per second but precisely calculated to around <\/span><\/span><\/div>
299,792,458 m\/s. That's why things moving at that speed sound so rapid compared to everyday experiences. <\/span><\/span><\/div>
It's a constant that underpins the fabric of spacetime and has far-reaching implications in both theoretical physics and applied fields.<\/span><\/span><\/div>
<\/span><\/span><\/div>
<\/think><\/span><\/span><\/div>
<\/span><\/span><\/div>
The speed of light is approximately **299,792,458 meters per second**, symbolized by the letter c. <\/span><\/span><\/div>
This is a fundamental constant in physics, unchanging at 299,792,458 m\/s exactly today. <\/span><\/span><\/div>
The unit \"m\u00b7s\u2212\u00b9\" indicates meters per second.<\/span><\/span><\/div>
<\/span><\/span><\/div>
The value of c was determined theoretically as electromagnetic waves travel through a vacuum, where electric and <\/span><\/span><\/div>
magnetic fields propagate instantaneously without needing any medium. <\/span><\/span><\/div>
It's crucial in special relativity because it serves as an invariant, meaning all observers agree on its speed <\/span><\/span><\/div>
irrespective of their relative motion. In high-speed scenarios like astrophysics, light travels across vast distances <\/span><\/span><\/div>
nearly instantaneously due to c's enormous value.<\/span><\/span><\/div>
<\/span><\/span><\/div>
In practical terms, the speed of light determines how quickly signals move across vast scales, such as in communication <\/span><\/span><\/div>
and astronomy. It also plays a key role in spacetime's theory, particularly in special relativity.<\/span><\/span><\/div>
<\/span><\/span><\/div>
The precise value is derived through detailed calculations from [Maxwell's equations, which <\/span><\/span><\/div>
describe electric and magnetic fields. Without c being this high, time dilation and relativistic effects <\/span><\/span><\/div>
would be negligible compared to the universe']s movement relative to light speed.<\/span><\/span><\/div>
<\/span><\/span><\/div>
In summary, the speed of light remains a constant, significantly impacting various areas of physics and our <\/span><\/span><\/div>
understanding of the universe.\"<\/span><\/span><\/div><\/div>
Wow that's a lot! I think this is an example of what many people refer to as <\/span>AI slop<\/span><\/a>. Whatever else it says, however, the model seems to be fairly sure that the speed of light is 299,792,458 meters per second which is correct <\/span>according to wikipedia<\/span><\/a>. <\/span><\/div>
This is a very small version of the DeepSeek model but it can still do useful things and is a fun and interesting way to learn about both the strengths and weaknesses of LLM-based AI technology. <\/span><\/div>
Have a play and tell me what you think.<\/span><\/div>
<\/div>\n<\/div>