Floating point conversion error?

S

Sebastian Hungerecker

Brandon said:
=> 224117

Anyone know what is up with that?

Floating point arithmetic isn't entirely accurate.=> "224117.999999999970896169543266296387"

And since 224117.999999999970896169543266296387.to_i is 224117, that's what
you get.

HTH,
Sebastian
 

Ask a Question

Want to reply to this thread or ask your own question?

You'll need to choose a username for the site, which only take a couple of moments. After that, you can post your question and our members will help you out.

Ask a Question

Members online

No members online now.

Forum statistics

Threads
473,744
Messages
2,569,484
Members
44,903
Latest member
orderPeak8CBDGummies

Latest Threads

Top