+ Reply to Thread
Results 1 to 8 of 8

Removing Duplicates of Large Excel Files

  1. #1
    Registered User
    Join Date
    03-22-2019
    Location
    Denver
    MS-Off Ver
    Mac 2011
    Posts
    3

    Question Removing Duplicates of Large Excel Files

    I have an excel file with 50,000+ records of first names, last names, addresses, etc. I would like to remove rows with duplicate email addresses while still keeping 1 of the records. I'm having a hard time getting the "remove duplicates" option to work. Any suggestions would be helpful.

    Thanks

  2. #2
    Forum Moderator jeffreybrown's Avatar
    Join Date
    02-19-2009
    Location
    Cibolo, TX
    MS-Off Ver
    Office 365
    Posts
    10,316

    Re: Removing Duplicates of Large Excel Files

    Hello & Welcome to the Forum,

    Without knowing what you have tried and how you are getting stuck, it's hard to help other than asking if you've seen a tutorial like this.

    https://www.excel-easy.com/examples/...uplicates.html
    HTH
    Regards, Jeff

  3. #3
    Registered User
    Join Date
    03-22-2019
    Location
    Denver
    MS-Off Ver
    Mac 2011
    Posts
    3

    Re: Removing Duplicates of Large Excel Files

    Hi Jeff sorry for the late reply. Basically, I have over 65,000 records of names, addresses, e-mail addresses. There is many duplicate rows of information, and I want to remove the duplicate rows based on e-mail addresses. If I highlight the whole spreadsheet, select remove duplicates from the data, and then only select column "G" where the e-mail addresses are stored, it then tells me I don't have any duplicates when I have them highlighted and can see clearly I do. Is there just to much information to sort through?

    Thanks,
    Danny

  4. #4
    Forum Expert Roel Jongman's Avatar
    Join Date
    03-28-2015
    Location
    Netherlands
    MS-Off Ver
    Office 365
    Posts
    1,483

    Re: Removing Duplicates of Large Excel Files

    make sure that you uncheck all columns except emailadress if you want to determine duplicate match only based on email.
    any other column you select will make excel evaluate all those columns combined for unique record

  5. #5
    Registered User
    Join Date
    03-22-2019
    Location
    Denver
    MS-Off Ver
    Mac 2011
    Posts
    3

    Re: Removing Duplicates of Large Excel Files

    I do make sure that only the email column is checked, but it still doesn't find any of the duplicates. Is there a size limit of records to filter through?

  6. #6
    Forum Expert shg's Avatar
    Join Date
    06-20-2007
    Location
    The Great State of Texas
    MS-Off Ver
    2003, 2010
    Posts
    40,678

    Re: Removing Duplicates of Large Excel Files

    You could whack the list to a dozen or so lines, alter the email addresses for anonymity, confirm that it still shows the problem, and then attach the workbook.
    Entia non sunt multiplicanda sine necessitate

  7. #7
    Forum Expert torachan's Avatar
    Join Date
    12-27-2012
    Location
    market harborough, england
    MS-Off Ver
    Excel 2010
    Posts
    4,302

    Re: Removing Duplicates of Large Excel Files

    If you have not already solved your dilemma, try the following approach.
    The attached has a hidden helper column "M" with the following helper formula in "M1" then copied down.

    Please Login or Register  to view this content.
    Then a Code/Macro run of the Command Button on sheet 1.
    torachan.
    Attached Files Attached Files
    Last edited by torachan; 03-27-2019 at 07:55 AM. Reason: attachment failed

  8. #8
    Forum Expert torachan's Avatar
    Join Date
    12-27-2012
    Location
    market harborough, england
    MS-Off Ver
    Excel 2010
    Posts
    4,302

    Re: Removing Duplicates of Large Excel Files

    bumpbumpbump

+ Reply to Thread

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. break large text files into multiple excel files
    By raghusri in forum Excel General
    Replies: 1
    Last Post: 11-15-2018, 03:02 PM
  2. Removing partial duplicates in a large data set in excel for mac
    By adam_d_john in forum Excel Formulas & Functions
    Replies: 5
    Last Post: 10-17-2017, 12:25 PM
  3. Checking two separate Excel files for Duplicates and removing them
    By thelegazy in forum Excel Programming / VBA / Macros
    Replies: 0
    Last Post: 06-25-2014, 08:19 PM
  4. Excel Function Removing Even Duplicates
    By gatefire08 in forum Excel Formulas & Functions
    Replies: 1
    Last Post: 05-08-2014, 07:00 AM
  5. [SOLVED] Split Large Excel file to multiple excel files and possible save the files
    By EnzioL in forum Excel Programming / VBA / Macros
    Replies: 4
    Last Post: 07-20-2012, 03:28 AM
  6. Excel 2007 : Removing Duplicates From Excel 2007
    By ndevil68 in forum Excel General
    Replies: 5
    Last Post: 05-01-2011, 02:52 PM
  7. Removing Duplicates on excel sheet
    By gmfrick in forum Excel General
    Replies: 3
    Last Post: 02-17-2009, 01:01 PM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Search Engine Friendly URLs by vBSEO 3.6.0 RC 1