+ Reply to Thread
Results 1 to 3 of 3

Forumula is adding 10+ Decimals during calculations

  1. 06-23-2015, 11:08 AM #1
    sapheri
    sapheri is offline
    Registered User
    Join Date
    06-23-2015
    Location
    Tampa, FL
    MS-Off Ver
    MS 2010
    Posts
    1

    Forumula is adding 10+ Decimals during calculations

    Hello,
    Here is the link to download my spreadsheet via google drive download: https://drive.google.com/file/d/0B1t...ew?usp=sharing[1]

    The purpose of the spreadsheet is to enter values in for the extraction volume, sensativity, efficiency factor and surface area to calculate micrograms/device and micrograms/cm2. The main portion of these calculations that is causing the decimals to display such large quantities is the Dilution volumes and the Total Dilution Volumes.

    When the dilution volumes becomes greater than 5 and the Total dilution volume greater than 9 the number of decimal places displayed goes from 2 to 10+.

    The formula for the total microgram/device are supposed to display "N/A" if the Sample ID is "N/A", If the total dilution volume displays 1.000 then the calculations should be the extraction volume * Hemastix sensitivity, if the total dilutions volume is not 1 then the total dilution volume is to be divided by the dilution volume and then multiplied by the sensitivity * extraction volume * Correction Factor.

    The formula for the Total Microgram/cm2 is to do the same thing as the Total microgram/device formula except if the Sample ID is "N/A" or the Extraction Volume is "N/A" then N/A is to be displayed.

    Thank you for the help!
    Reply With QuoteRegister To Reply
  2. 06-23-2015, 11:29 AM #2
    6StringJazzer
    6StringJazzer is offline
    Administrator 6StringJazzer's Avatar
    Join Date
    01-27-2010
    Location
    Tysons Corner, VA, USA
    MS-Off Ver
    MS365 Family 64-bit
    Posts
    24,725

    Re: Forumula is adding 10+ Decimals during calculations

    Quote Originally Posted by sapheri View Post
    When the dilution volumes becomes greater than 5 and the Total dilution volume greater than 9 the number of decimal places displayed goes from 2 to 10+.
    This is not entirely true; it has nothing to do with being greater than 5. In row 9, when the dilution volume is increased from 7 to 8, the results are "<125" and "<1.25". When dilution volume is 7, your results are 100/7 and 10/7, which are both repeating decimals. So you are going to get the maximum number of decimals that Google Sheets will display (by the way, this is not Excel so I moved your thread).

    If you always want two decimal places then you either need to use a display format that shows only two decimal places (not a good option because you are building a string), or you need to round, like this:

    Formula: copy to clipboard 
    Please Login or Register  to view this content.
    Jeff
    | | |·| |·| |·| |·| | |:| | |·| |·|
    Read the rules
    Use code tags to [code]enclose your code![/code]
    Reply With QuoteRegister To Reply
  3. 06-23-2015, 11:40 AM #3
    jhren
    jhren is offline
    Valued Forum Contributor
    Join Date
    05-20-2013
    Location
    Ohio, USA
    MS-Off Ver
    Excel 2013
    Posts
    941

    Re: Forumula is adding 10+ Decimals during calculations

    Slightly different...
    Formula: copy to clipboard 
    Please Login or Register  to view this content.
    Reply With QuoteRegister To Reply
+ Reply to Thread
« Previous Thread | Next Thread »

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. How do I adding a condition to an IF and Vlookup forumula
    By Coors in forum Excel General
    Replies: 2
    Last Post: 08-28-2009, 12:33 PM
  2. Calculations with increasing decimals shown
    By tpampel in forum Excel General
    Replies: 1
    Last Post: 05-01-2007, 06:12 PM
  3. [SOLVED] Adding Decimals
    By [email protected] in forum Excel General
    Replies: 2
    Last Post: 07-27-2006, 01:00 PM
  4. Adding Decimals
    By [email protected] in forum Excel General
    Replies: 0
    Last Post: 07-27-2006, 12:45 PM
  5. Adding Decimals
    By Michael Brown in forum Excel General
    Replies: 3
    Last Post: 06-19-2006, 06:50 PM

Tags for this Thread

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Forum Rules


Search Engine Friendly URLs by vBSEO 3.6.0 RC 1