+ Reply to Thread
Results 1 to 15 of 15

Remove Duplicates so you only see unique records

  1. #1
    Registered User
    Join Date
    10-12-2016
    Location
    Toronto
    MS-Off Ver
    7
    Posts
    5

    Remove Duplicates so you only see unique records

    I have consolidated two spreadsheets. Some are duplicate records. I want to only see the unique records. So if I have one data set of 100 and the other is 150, I want to see the 50 unique records either in the same sheet or in a different sheet. How do I do this?

  2. #2
    Forum Moderator AliGW's Avatar
    Join Date
    08-10-2013
    Location
    Retired in Ipswich, Suffolk, but grew up in Sawley, Derbyshire (England)
    MS-Off Ver
    MS 365 Subscription Insider Beta Channel v. 2405 (Windows 11 23H2 64-bit)
    Posts
    81,421

    Re: Remove Duplicates so you only see unique records

    Get all of the data into one column, then something along these lines:

    =IFERROR(INDEX($A$2:$A$10,MATCH(0,INDEX(COUNTIF($B$1:B1,$A$2:$A$10),0,0),0)),"")

    where A2 to A10 is your original list with duplicates.

    Must be entered into B2 - won't work in B1. The B column reference needs to reference the cell ABOVE where the list starts.
    Ali


    Enthusiastic self-taught user of MS Excel who's always learning!
    Don't forget to say "thank you" in your thread to anyone who has offered you help.
    You can reward them by clicking on * Add Reputation below their user name on the left, if you wish.

    Forum Rules (updated August 2023): please read them here.

  3. #3
    Registered User
    Join Date
    10-12-2016
    Location
    Toronto
    MS-Off Ver
    7
    Posts
    5

    Re: Remove Duplicates so you only see unique records

    Thanks so much. I did that. But you can see it is given me Even Young who has a duplicate and I only want non duplicates

    [email protected] Independant Tour Merchandise Manager [email protected]
    [email protected] Independant Tour Merchandise Manager [email protected]
    [email protected] Associate Producer [email protected]
    [email protected] Account Manager [email protected]

  4. #4
    Forum Moderator AliGW's Avatar
    Join Date
    08-10-2013
    Location
    Retired in Ipswich, Suffolk, but grew up in Sawley, Derbyshire (England)
    MS-Off Ver
    MS 365 Subscription Insider Beta Channel v. 2405 (Windows 11 23H2 64-bit)
    Posts
    81,421

    Re: Remove Duplicates so you only see unique records

    Sorry - I don't understand your data. There are no duplicates: each row is different, as far as I can see. Are there meant to be three columns here? Perhaps you should provide us with a representative sample of your data?

    Attach a sample workbook. Make sure there is just enough data to demonstrate your need. Include a BEFORE sheet and an AFTER sheet in the workbook if needed to show the process you're trying to complete or automate. Make sure your desired results are shown, mock them up manually if necessary.

    Remember to desensitize the data.

    Click on GO ADVANCED and then scroll down to Manage Attachments to open the upload window.

  5. #5
    Registered User
    Join Date
    10-12-2016
    Location
    Toronto
    MS-Off Ver
    7
    Posts
    5

    Re: Remove Duplicates so you only see unique records

    So you see Dawsyn? This is a non duplicate. I would like to find all the non duplicates. I can only find by email address (column D)
    Headers start on A1

    Company First Last Email Position
    --- Evan Young [email protected] Independant Tour Merchandise Manager
    --- Evan Young [email protected] Independant Tour Merchandise Manager
    "Daily Planet" on Discovery Canada Dawsyn Borland [email protected] Associate Producer
    #paid Maxime Houde-Shulman [email protected] Account Manager
    ????????? Andy zhang [email protected] Sales Manager
    ????????? Andy zhang [email protected] Sales Manager
    ?????????????? xu an [email protected] ????
    ?????????????? xu an [email protected] ????
    ` Jodi Fenwick Yackness [email protected] Assistant Director

  6. #6
    Forum Moderator AliGW's Avatar
    Join Date
    08-10-2013
    Location
    Retired in Ipswich, Suffolk, but grew up in Sawley, Derbyshire (England)
    MS-Off Ver
    MS 365 Subscription Insider Beta Channel v. 2405 (Windows 11 23H2 64-bit)
    Posts
    81,421

    Re: Remove Duplicates so you only see unique records

    Could you please provide a workbook?

  7. #7
    Registered User
    Join Date
    10-12-2016
    Location
    Toronto
    MS-Off Ver
    7
    Posts
    5

    Re: Remove Duplicates so you only see unique records

    No clue how to send an attachment. I put in manage attachment
    Attached Files Attached Files

  8. #8
    Forum Moderator AliGW's Avatar
    Join Date
    08-10-2013
    Location
    Retired in Ipswich, Suffolk, but grew up in Sawley, Derbyshire (England)
    MS-Off Ver
    MS 365 Subscription Insider Beta Channel v. 2405 (Windows 11 23H2 64-bit)
    Posts
    81,421

    Re: Remove Duplicates so you only see unique records

    Thanks. I don't see where you have tried to use the formula or given any expected outcomes. Is the duplication you want to get rid of dependent on the Email column? If so, use my formula to filter out the duplicates in that column and then do a VLOOKUP or INDEX MATCH to pull through the associated data.
    Last edited by AliGW; 10-12-2016 at 10:59 AM.

  9. #9
    Registered User
    Join Date
    10-12-2016
    Location
    Toronto
    MS-Off Ver
    7
    Posts
    5

    Re: Remove Duplicates so you only see unique records

    I did put in the formula and nothing happened. All I want is to see the non duplicate data. So I don't want "Evan Young" as a result. Understand? Sorry I really appreciate your help.

  10. #10
    Forum Moderator AliGW's Avatar
    Join Date
    08-10-2013
    Location
    Retired in Ipswich, Suffolk, but grew up in Sawley, Derbyshire (England)
    MS-Off Ver
    MS 365 Subscription Insider Beta Channel v. 2405 (Windows 11 23H2 64-bit)
    Posts
    81,421

    Re: Remove Duplicates so you only see unique records

    I am trying to completely understand - honest! :-)

    I added a question to my last post: did you see it?

  11. #11
    Forum Moderator AliGW's Avatar
    Join Date
    08-10-2013
    Location
    Retired in Ipswich, Suffolk, but grew up in Sawley, Derbyshire (England)
    MS-Off Ver
    MS 365 Subscription Insider Beta Channel v. 2405 (Windows 11 23H2 64-bit)
    Posts
    81,421

    Re: Remove Duplicates so you only see unique records

    Does this help:

    Excel 2016 (Windows) 32 bit
    L
    M
    N
    O
    P
    Q
    1
    2
    [email protected] --- Evan Young Independant Tour Merchandise Manager
    3
    [email protected] "Daily Planet" on Discovery Canada Dawsyn Borland Associate Producer
    4
    [email protected] #paid Maxime Houde-Shulman Account Manager
    5
    [email protected] ????????? Andy zhang Sales Manager
    6
    [email protected] ?????????????? xu an ????
    7
    [email protected] ` Jodi Fenwick Yackness Assistant Director
    8
    [email protected] 1 litre water company Arie Sibonney President
    9
    [email protected] 1215creative Jennifer Duong Director of Virtual Reality
    10
    [email protected] 20/20 Armor Ali Ghafour Founder, CEO, Director
    11
    [email protected] 20th Century Fox Mike Morgan Director, Production & Post Production Technology; Fox Innovation Lab
    Sheet: Sheet1

    Excel 2016 (Windows) 32 bit
    L
    M
    N
    O
    P
    2
    =IFERROR(INDEX($D$2:$D$17,MATCH(0,INDEX(COUNTIF($L$1:L1,$D$2:$D$17),0,0),0)),"") =INDEX($A$2:$A$17,MATCH($L2,$D$2:$D$17,0),0) =INDEX($B$2:$B$17,MATCH($L2,$D$2:$D$17,0),0) =INDEX($C$2:$C$17,MATCH($L2,$D$2:$D$17,0),0) =INDEX($E$2:$E$17,MATCH($L2,$D$2:$D$17,0),0)
    Sheet: Sheet1

  12. #12
    Valued Forum Contributor
    Join Date
    10-14-2012
    Location
    Netherlands
    MS-Off Ver
    Excel 2019
    Posts
    353

    Re: Remove Duplicates so you only see unique records

    Did you consider yet a pivot table ?
    This feature is specially designed for that.
    Kind regards,
    Piet Bom

  13. #13
    Forum Guru
    Join Date
    04-13-2005
    Location
    North America
    MS-Off Ver
    2002/XP and 2007
    Posts
    15,858

    Re: Remove Duplicates so you only see unique records

    I tried using Advanced Filter -> Unique records -> copy to another location and got the following result. Is that the result you are looking for?

    Advanced filter tutorial: http://www.contextures.com/xladvfilter01.html
    Attached Files Attached Files
    Quote Originally Posted by shg
    Mathematics is the native language of the natural world. Just trying to become literate.

  14. #14
    Forum Moderator
    Join Date
    01-21-2014
    Location
    St. Joseph, Illinois U.S.A.
    MS-Off Ver
    Office 365 v 2404
    Posts
    13,407

    Re: Remove Duplicates so you only see unique records

    All I want is to see the non duplicate data. So I don't want "Evan Young" as a result
    Are we to understand that the desired output is more like this?

    Row\Col
    H
    I
    J
    K
    L
    1
    Company First Last Email Position
    2
    "Daily Planet" on Discovery Canada Dawsyn Borland [email protected] Associate Producer
    3
    #paid Maxime Houde-Shulman [email protected] Account Manager
    4
    20/20 Armor Ali Ghafour [email protected] Founder, CEO, Director
    5
    20th Century Fox Mike Morgan [email protected] Director, Production & Post Production Technology; Fox Innovation Lab
    Dave

  15. #15
    Registered User
    Join Date
    10-12-2016
    Location
    London, England
    MS-Off Ver
    MIcrosoft Excel for Mac Version 16.33
    Posts
    17

    Re: Remove Duplicates so you only see unique records

    I am guessing you have already tried 'Remove Duplicates' under the 'Data' tab in the 'Data Tools' section? No-one seems to have mentioned this and I cannot see why it would not work with your data..

    Edit: I downloaded your data file, highlighted all of the data, clicked 'remove duplicates' clicked 'select all', and then 'ok'. It removed the 6 duplicates leaving me with the 10 unique values.
    Last edited by zvba010; 10-12-2016 at 09:27 PM.

+ Reply to Thread

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. remove all duplicates, but keep only unique
    By TheTrooper1 in forum Excel General
    Replies: 2
    Last Post: 05-27-2015, 10:51 AM
  2. Move Unique records and Duplicates in separate sheets
    By fareen in forum Excel Programming / VBA / Macros
    Replies: 3
    Last Post: 06-23-2013, 03:30 AM
  3. Replies: 5
    Last Post: 04-30-2013, 07:42 PM
  4. [SOLVED] Extract unique records from data set with duplicates
    By dwhite30518 in forum Excel Programming / VBA / Macros
    Replies: 2
    Last Post: 04-17-2013, 11:17 AM
  5. adv. filter unique records only returns duplicates
    By stratplayer in forum Excel General
    Replies: 4
    Last Post: 01-31-2011, 05:52 PM
  6. Replies: 1
    Last Post: 01-07-2011, 04:06 PM
  7. Deleting Duplicates, All records unique
    By mirdonamy in forum Excel General
    Replies: 7
    Last Post: 01-11-2006, 06:10 PM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Search Engine Friendly URLs by vBSEO 3.6.0 RC 1