{"id":301,"date":"2015-11-03T08:50:17","date_gmt":"2015-11-03T08:50:17","guid":{"rendered":"https:\/\/blogs.mathworks.com\/developer\/?p=301"},"modified":"2015-11-03T08:50:17","modified_gmt":"2015-11-03T08:50:17","slug":"tap-diagnostics-and-junit-xml","status":"publish","type":"post","link":"https:\/\/blogs.mathworks.com\/developer\/2015\/11\/03\/tap-diagnostics-and-junit-xml\/","title":{"rendered":"Format Sibling Rivalry"},"content":{"rendered":"\r\n

Goodness time flies! It has been a while since we've had a blog update, While I really would like to keep the conversation we have going on here moving, this is how I would like you to envision what I have been up to recently:<\/p>

\"\" <\/p>

That's right...just think of me as your code monkey, tirelessly pushing forward developer oriented infrastructure (and blog topics). We do indeed have a lot of exciting things we are working on in MATLAB that we will definitely discuss here when the time comes. I can't wait.<\/p>

However, there are already so many discussions to explore. Today I wanted to highlight another Continuous Integration workflow improvement that is available now that R2015b has been released.<\/p>

The Beauty is in the Details<\/b><\/p>

If you remember<\/a>, MATLAB can connect to CI Systems like Jenkins™ which can be configured to run your tests periodically and\/or whenever files are modified in your source control system. This is done using the TAPPlugin<\/a> for the MATLAB TestRunner. This plugin has been enhanced in R2015b to show the diagnostic information in the TAP stream for an improved display in the CI reports. For example, with absolutely no change in the script discussed in the earlier post, the Jenkins output now includes the diagnostics (we heard you Aditya<\/a>!). So, for the following failing test:<\/p>

\r\nclassdef<\/span> NumericsTest < matlab.unittest.TestCase\r\n    % Copyright 2012 The MathWorks, Inc.<\/span>\r\n    \r\n    methods<\/span>(Test)\r\n        function<\/span> shouldReallyBePi(testCase)\r\n            wannabePi = 22\/7;\r\n            testCase.verifyEqual(wannabePi, pi, 'RelTol'<\/span>, 1e-8, ...<\/span>\r\n                'I am not gonna allow 22\/7 as a stand in for pi!'<\/span>);\r\n        end<\/span>\r\n    end<\/span>\r\nend<\/span>\r\n\r\n<\/pre>
We now see the helpful diagnostics right in the Jenkins reports.<\/p>
\"\" <\/p>
Of course this may differ depending on how your particular CI system presents the TAP output, but MATLAB is certainly providing a richer TAP stream to begin with.<\/p>
A Horse of a Different Format<\/b><\/p>
Speaking of different CI systems, while Jenkins is great to highlight because it is simple to show in a short blog post and is popular to boot, but there are of course many other CI systems out there. One of the reasons I am a supporter of the TAP format is because it aims to be language independent. However, unfortunately there are some CI systems that simply don't have the capability to process TAP streams. The de-facto JUnit XML format (which is in fact the xml output produced by the Apache Ant JUnit task) is very widespread and supported by some CI systems that do not support the TAP protocol. Once again, R2015b to the rescue because test results can now be exported to the JUnit format using the new XMLPlugin<\/a>. This allows a few benefits:<\/p>