Posts 11 - 20 of 27

結果: Precision

Ulps Plots Reveal Math Function Accuracy 2

"ULP" stands for "unit in the last place." An ulps plot samples a fundamental math function such as $\sin{x}$, or a more esoteric function like a Bessel function. The samples are compared with more accurate values obtained from a higher precision computation. A plot of the accuracy, measured in ulps, reveals valuable information about the underlying algorithms.... 続きを読む >>

Posts 11 - 20 of 27