+ Reply to Thread
Results 1 to 6 of 6

floating point error or match type issue??

  1. #1
    Registered User
    Join Date
    09-13-2012
    Location
    Munich Germany
    MS-Off Ver
    Microsoft office Home and Student 2016
    Posts
    14

    floating point error or match type issue??

    Hello again,

    I thought I had this figured out from my last inquiry but this one I just cannot understand.

    Attached is my workbook with references to 2 sheets ELEV and KALK. In the KALK sheet, the 2 cells highlighted in yellow should be returning "-03" from the table in sheet ELEV. At the moment it only working for some elevations but not this one. all number cell in the formulas are being rounded to 3 significant figures, however the match is still not working (the rounding was the fix last time). I tried match type -1 and that really didn't work.

    I hope this isn't some other Floating point error issue.

    regards,
    David
    Attached Files Attached Files

  2. #2
    Forum Guru TMS's Avatar
    Join Date
    07-15-2010
    Location
    The Great City of Manchester, NW England ;-)
    MS-Off Ver
    MSO 2007,2010,365
    Posts
    44,466

    Re: floating point error or match type issue??

    No, it's because 1111110 does not exist in the Lookup Table
    Trevor Shuttleworth - Retired Excel/VBA Consultant

    I dream of a better world where chickens can cross the road without having their motives questioned

    'Being unapologetic means never having to say you're sorry' John Cooper Clarke


  3. #3
    Registered User
    Join Date
    09-13-2012
    Location
    Munich Germany
    MS-Off Ver
    Microsoft office Home and Student 2016
    Posts
    14

    Re: floating point error or match type issue??

    The columns with the code that you are referring to are not associated with this problem. The cells that I highlighted in yellow contain the issue.

    Attached is the workbook again for reference.
    Attached Files Attached Files

  4. #4
    Forum Guru
    Join Date
    09-10-2017
    Location
    Chippenham, England
    MS-Off Ver
    365
    Posts
    15,084

    Re: floating point error or match type issue??

    It is floating point errors, you need to round after doing the maths, in AL11 use
    =IFERROR(IF(LEFT(M11,4)="ELEV","",(ROUND(W11-(AK11/2),3))),"")

  5. #5
    Registered User
    Join Date
    09-13-2012
    Location
    Munich Germany
    MS-Off Ver
    Microsoft office Home and Student 2016
    Posts
    14

    Re: floating point error or match type issue??

    jeez that seemed too easy for you
    Problem solved! thank you for your help!
    This forum is awesome, and fast. I hope to return the favor someday.
    Thanks again and have a relaxed week.

    warm regards,
    David

  6. #6
    Forum Guru
    Join Date
    09-10-2017
    Location
    Chippenham, England
    MS-Off Ver
    365
    Posts
    15,084

    Re: floating point error or match type issue??

    You're welcome & thanks for the feedback.

+ Reply to Thread

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. extracting floating point numbers
    By curious36 in forum Excel Formulas & Functions
    Replies: 15
    Last Post: 07-19-2019, 04:01 AM
  2. Floating Decimal Point Error
    By cathyinaz in forum Excel General
    Replies: 7
    Last Post: 05-11-2018, 05:04 PM
  3. Floating point in VBA
    By Rob K in forum Excel Programming / VBA / Macros
    Replies: 3
    Last Post: 05-21-2015, 05:14 AM
  4. Bitoperations with floating point numbers
    By Parity in forum Excel Programming / VBA / Macros
    Replies: 2
    Last Post: 04-07-2006, 07:00 AM
  5. [SOLVED] Floating Point
    By Kathleen Bell in forum Excel General
    Replies: 2
    Last Post: 01-10-2006, 01:15 AM
  6. [SOLVED] Floating point problem??
    By Frederick Chow in forum Excel Programming / VBA / Macros
    Replies: 6
    Last Post: 01-02-2006, 11:40 PM
  7. Floating Point Functions
    By Joel in forum Excel Programming / VBA / Macros
    Replies: 6
    Last Post: 03-30-2005, 06:06 PM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Search Engine Friendly URLs by vBSEO 3.6.0 RC 1