Posts 1 - 10 of 28

Results for: Precision

IBM Hexadecimal Floating Point

Our technical support group recently received a request for a tool that would convert IBM System/360 hexadecimal floating point numbers to the IEEE-754 format. I am probably the only one left at MathWorks that actually used IBM mainframe computers. I thought we had seen the last of hexadecimal arithmetic years ago. But, it turns out that the hexadecimal floating point format is alive and well.... read more >>

Round, With Tie Breakers, A Prototype

In February and March I published three blog posts about an enhancement request for MATLAB concerning tie breakers with the round function, including the ability to round ties to even. Round One, Round Two and Round Three. Since then, a group of us at MathWorks, organized by my colleague (and academic great-great-grand-descendant) Heiko Weichelt, have been considering the request. We had a virtual design review recently. This post describes a prototype incorporating the features that were discussed at that review.... read more >>

Round, With Tie Breakers, Round Three 1

I recently published Round, With Ties to Even and followed that with Round Two. Then, in an email, Andy Bartlett pointed out that my new round function fails for some large values of x between flintmax/2 and flintmax.... read more >>

Round, With Tie Breakers, Round Two

I published Round, With Ties to Even a couple of days ago. Steve Eddins and Daniel Dolan immediately had substantive comments. Here is my reaction to their comments.... read more >>

Round, With Ties to Even 2

We are considering a MATLAB Enhancement Request to support options for round(x) when x is exactly halfway between two integers.... read more >>

Precise Setting of a Delicate Parameter with “pibar”

(A slight revision of the post I made a few hours ago.)... read more >>

Pejorative Manifolds of Polynomials and Matrices, part 2

In an unpublished 1972 technical report "Conserving confluence curbs ill-condition," Velvel Kahan coined the descriptive term pejorative manifold. In case you don't use it in everyday conversation, pejorative means "expressing contempt or disapproval."... read more >>

Pejorative Manifolds of Polynomials and Matrices, part 1 2

In an unpublished 1972 technical report "Conserving confluence curbs ill-condition," Velvel Kahan coined the descriptive term pejorative manifold. In case you don't use it in everyday conversation, pejorative means "expressing contempt or disapproval."... read more >>

A Matrix for the New HPL-AI Benchmark 2

My colleagues are looking for a matrix to be used in a new benchmark. They've come to the right place.... read more >>

Continued Fractions and Function “rat” 1

Let me tell you about MATLAB's controversial function rat.... read more >>

Posts 1 - 10 of 28