logical yields right result but does't factor correctly
divided 18513 by 18514
get result 0.999946
subtract from 1, get 0.000054
use following formula to get number 2771 as result
formula is as follows<=if(G17<G18,G17,G18)> where g17=2771 and g18=2771
this returns result 2771. Purpose is to choose lesser of G17 or G18
but when I multiply 0.000054 by the location containing the =if function, which has value 2771, the answer returned is 0.14967052 instead of 0.149634
Any help with this?
Last edited by trbodden; 09-15-2009 at 08:56 AM. Reason: moderator request?
Re: logical yields right result but does't factor correctly
Partly resolved - the number 18513/18514 is actually 0.999945987, not 0.999946 and the computer does not round off to do the math so now I have a new question. How can I force it to operate only to the sixth decimal place rounded off?
=round(18513/18514, 6)
Microsoft MVP - Excel
Entia non sunt multiplicanda sine necessitate
There are currently 1 users browsing this thread. (0 members and 1 guests)
Posting Permissions
Reply With Quote
Bookmarks