Comments on: Video tutorial: Tolerances in comparisons

By: Leonardo Glavina

Leonardo Glavina — Thu, 23 Apr 2009 12:20:29 +0000

That’s true Seth, but you can use a type of trick to make it more precise, like [i]round(100*w)/100[/i] or even [i]round(1000*w)/1000[/i].

Anyway, great solution Doug… I was having a little bit of problem with that, when I was making comparisons to find the intersection points of plots, and this method can be better than mine.

By: Seth Popinchalk

Seth Popinchalk — Sat, 06 Dec 2008 14:58:38 +0000

@paramesh - I don’t like the ROUND solution at all. That would return true for 1.4 and .6! As matt fig points out, you need to set a tolerance bound on your comparison.

By: matt fig

matt fig — Tue, 02 Dec 2008 18:13:09 +0000

paramesh,

Your solution will work if the integer is known, as it is in this case (1). However Doug’s solution is more general in that it can be applied to determine if an integer is present when the integer may be unknown. As in:

abs(round(N) - N)

Where N can be an array of possible integers which resulted from a previous calculation. This will be true when integers are found in N and false where not.

By: paramesh

paramesh — Tue, 02 Dec 2008 16:49:53 +0000

Hi Doug,

Nice point. But instead, won’t the function “round” work? Say, “if round(answer) == 1″.