Avatar

Too float to Fail (Gaming)

by dogcow @, Hiding from Bob, in the vent core., Wednesday, April 06, 2016, 13:53 (3156 days ago) @ uberfoop

Floating point rounding isn't a hardware error, it's a known mathematical error implemented in hardware. While it sometimes differs by processor (i.e. when the floating point hardware isn't using IEEE standard behavior), it's typically a deterministic element, and one that a programmer can usually know the behavior of.

Yup, and I get to fix one of those errors today. :)


Complete thread:

 RSS Feed of thread