+ Reply to Thread
Results 1 to 3 of 3

How much of this data cleaning job can be sped up / automated by Excel?

  1. #1
    Registered User
    Join Date
    02-29-2016
    Location
    United Kingdom
    MS-Off Ver
    2010
    Posts
    2

    How much of this data cleaning job can be sped up / automated by Excel?

    Hello,

    My company is currently working on cleaning a database of roughly 22'000 customers. We have exported the customer list to Excel and want to make sure all the data is formatted correctly and in the right fields before re-importing into our system.

    The formatting is not an issue, a few =PROPER and =TRIM formulas and some Find & Replacing will do the trick.

    The problem is moving information into the correct columns and making everything structured and uniform.

    The process for inputting and importing data has changed over the years and the result is that the data is very random. Certain standards were only adopted later on (eg. using US as a country code, whereas before it could be anything from U.S., U.S, USA, U.S.A, United States, America, etc...)

    Additionally customers might have inputted their addresses in different ways, eg. city and state separated by a comma or space in one field instead of having them in different fields. It has even gone so far as in customers inputting their numbers next to their names (eg. Mike 0123456789).

    I would post a screenshot however to protect our customers' privacy I am unable to do so.

    Currently the only way we'd know how to clean this is to manually go through each entry. We've been advised to hire an 'Excel wizard' who can do all sorts of things with Excel through formulas, automation, macros, etc... We have however been asking ourselves how helpful this might be considering the high level of randomness and lack of structure with the data.

    Would you recommend hiring an expert freelancer for the job or giving the data to an admin / data center to clean manually? With the latter there is obviously the risk of handing the data to scammers who will sell the information or phish the customers. This is a bit of a tough situation and any advice is much appreciated.

    Many thanks in advance,
    David

  2. #2
    Forum Moderator davesexcel's Avatar
    Join Date
    02-19-2006
    Location
    Regina
    MS-Off Ver
    MS 365
    Posts
    13,485

    Re: How much of this data cleaning job can be sped up / automated by Excel?

    When supplying a sample workbook to the forum, you don't actually supply the workbook, you supply a mock-up of the workbook. That's why when we ask for a sample workbook we make sure to explain not to include real data.

    Attaching a sample workbook enables others to work on your problem:

    To attach a sample workbook. Make sure there is just enough data to make it clear what is needed. Include BEFORE/AFTER sheets if needed to show the process you're trying to complete or automate. Remember to desensitize the data.

    Click on GO ADVANCED and use the paperclip icon to open the upload window.

    View Pic

    To add a file to a new post

    To add a file to an existing post.

  3. #3
    Registered User
    Join Date
    02-29-2016
    Location
    United Kingdom
    MS-Off Ver
    2010
    Posts
    2

    Re: How much of this data cleaning job can be sped up / automated by Excel?

    Many thanks, here is the sample workbook. I hope that something like this is what you were looking for?+
    Attached Files Attached Files
    Last edited by DDLSDW; 02-29-2016 at 11:31 AM.

+ Reply to Thread

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. Automated way of importing specific financial data from 10-K filings in excel
    By KingMidas in forum For Other Platforms(Mac, Google Docs, Mobile OS etc)
    Replies: 0
    Last Post: 05-10-2015, 10:02 AM
  2. Replies: 0
    Last Post: 11-04-2014, 03:57 PM
  3. Automated data scraping from website into excel
    By kavin in forum Excel Programming / VBA / Macros
    Replies: 1
    Last Post: 09-10-2014, 01:42 PM
  4. Replies: 1
    Last Post: 02-17-2014, 11:21 PM
  5. Automated Word form data to Excel and back
    By tylkum in forum Excel Programming / VBA / Macros
    Replies: 0
    Last Post: 02-19-2013, 08:05 PM
  6. How to Transfer data from one excel to another(Automated)
    By induin06 in forum Excel Programming / VBA / Macros
    Replies: 2
    Last Post: 02-19-2013, 07:39 AM
  7. Formula Be Sped Up?
    By natepen in forum Excel General
    Replies: 3
    Last Post: 03-22-2007, 01:30 PM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Search Engine Friendly URLs by vBSEO 3.6.0 RC 1