{"id":1219,"date":"2023-05-15T13:30:08","date_gmt":"2023-05-15T17:30:08","guid":{"rendered":"https:\/\/blogs.mathworks.com\/matlab\/?p=1219"},"modified":"2023-05-15T13:30:08","modified_gmt":"2023-05-15T17:30:08","slug":"from-hpc-consultancy-to-a-faster-fzero-function-in-matlab-r2023a","status":"publish","type":"post","link":"https:\/\/blogs.mathworks.com\/matlab\/2023\/05\/15\/from-hpc-consultancy-to-a-faster-fzero-function-in-matlab-r2023a\/","title":{"rendered":"From HPC consultancy to a faster fzero function in MATLAB R2023a"},"content":{"rendered":"
\r\n
Sometime in 2021, I was doing some High Performance Computing (HPC) consultancy with a university in the south of England. This involved various things such as getting the code to scale across multiple nodes, reducing memory requirements and speed optimisation. It was a big success and I got code that originally couldn't run at all on their HPC system to not only run but scale quite nicely. Then I threw in a 6x speed increase as a bonus by optimising the user's code.<\/div>\r\n
I eventually got stuck with MATLAB's fzero<\/span><\/a> function. The user's code was calling it billions of times on rather simple functions which revealed overheads that nobody had reported before.<\/div>\r\n
I had a chat with development who did some fixes and in R2022a, <\/span>fzero<\/span> was made around 3x faster than before<\/span> for simple cases like this. This was nice but a member of the core math team, Bobby Cheng, wanted to investigate further. He made a few more optimisations and also discovered that any function using varargin<\/span> had some additional overheads that could be resolved via the JIT compiler. The team behind JIT compilation took care of this and now many functions using varargin<\/span><\/a> have been made a little faster.<\/div>\r\n
These fixes made fzero<\/span> even faster on the simple type of function that was being used in my HPC case. The release notes always compare against the previous MATLAB version but to show the cumulative gains, I prefer to compare this benchmark against R2021b which is when I first noticed issues with this function.<\/div>\r\n
\r\n
\r\n
N = 1e6;<\/span><\/div>\r\n<\/div>\r\n
\r\n
rng default<\/span><\/span><\/div>\r\n<\/div>\r\n
\r\n
levels = 1.5*rand(N,1);<\/span><\/div>\r\n<\/div>\r\n
\r\n
out = zeros(N,1);<\/span><\/div>\r\n<\/div>\r\n
\r\n
tic<\/span><\/div>\r\n<\/div>\r\n
\r\n
for <\/span>i = 1:N<\/span><\/div>\r\n<\/div>\r\n
\r\n
out(i) = fzero(@(x)fzeroFun(x,levels(i)),[0 2]);<\/span><\/div>\r\n<\/div>\r\n
\r\n
end<\/span><\/span><\/div>\r\n<\/div>\r\n
\r\n
toc<\/span><\/div>\r\n
\r\n
\r\n
Elapsed time is 1.669698 seconds.<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n
    \r\n \t
  • R2021b: 28.52 seconds<\/li>\r\n \t
  • R2022a: 10.25 seconds<\/li>\r\n \t
  • R2023a: 1.67 seconds<\/li>\r\n<\/ul>\r\n
    That's almost a 17x speedup across a few releases and users do not need to change their code at all!<\/span> The cumulative effect of all of these optimisations really adds up over time.<\/div>\r\n
    Function definition<\/span><\/div>\r\n
    \r\n
    \r\n
    function <\/span>u = fzeroFun(x,lv)<\/span><\/div>\r\n<\/div>\r\n
    \r\n
    % The function to be solved by fzero<\/span><\/span><\/div>\r\n<\/div>\r\n
    \r\n
    u = x*sin(x) - lv;<\/span><\/div>\r\n<\/div>\r\n
    \r\n
    end<\/span><\/span><\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n