When I try to check a solution of 15 decimals, often Excel will miss compute the last decimal.
I have checked a computations that excel showed as wrong, and found out Excel was wrong at so many decimals.
When I try to check a solution of 15 decimals, often Excel will miss compute the last decimal.
I have checked a computations that excel showed as wrong, and found out Excel was wrong at so many decimals.
It's not just Excel. Double precision (15 digits) has been the standard for computer computations for years. Occasionally I have seen add-ins that use numbers as text strings to get higher precision, but they don't seem to be universally accepted. I've also heard of some programming languages that offer quad-precision (30 digits), but, again, it is not very common. I think it is because it is a very rare problem that really needs better than parts per quadrillion precision. If your problem really needs better than parts per quadrillion precision, I would suggest that, in the long term, you will be better served by learning a programming language that offers quad-precision.
Originally Posted by shg
Here's a lexographic program for very large integers.
http://www.ozgrid.com/forum/showthread.php?t=78323
_
...How to Cross-post politely...
..Wrap code by selecting the code and clicking the # or read this. Thank you.
curious what type of work needs that level of precision.
There are currently 1 users browsing this thread. (0 members and 1 guests)
Bookmarks