+ Reply to Thread
Results 1 to 14 of 14

How to Organize Scraped Data

  1. #1
    Registered User
    Join Date
    06-04-2015
    Location
    Calgary
    MS-Off Ver
    2013
    Posts
    12

    How to Organize Scraped Data

    Hello Friends,

    I have recently scraped data from several webpages into individual tabs in excel. Unfortunately the data is messy in the individual work sheets in work book. I would like to sort or create a mechanism to pick and organize information from each of the individual worksheets. Hope you know of a work around this problem.

  2. #2
    Forum Expert dflak's Avatar
    Join Date
    11-24-2015
    Location
    North Carolina
    MS-Off Ver
    365
    Posts
    7,920

    Re: How to Organize Scraped Data

    It would help if you could attach a sample workbook. We have no idea how messy "messy" is.

  3. #3
    Registered User
    Join Date
    06-04-2015
    Location
    Calgary
    MS-Off Ver
    2013
    Posts
    12

    Re: How to Organize Scraped Data

    Oh thanks dflak ! Here's my data. I want a way to categorize the data automatically.
    Attached Files Attached Files

  4. #4
    Forum Expert dflak's Avatar
    Join Date
    11-24-2015
    Location
    North Carolina
    MS-Off Ver
    365
    Posts
    7,920

    Re: How to Organize Scraped Data

    Well, the good news is that the data seems to be in the same format on all the sheets.

    What would you like the final result to look like? Can you provide a sample? Do you want a single sheet for each data sheet or do you want them consolidated into one sheet?

    You will probably have to set up a table that says something like: put this cell in the source to this place on the target sheet.

  5. #5
    Registered User
    Join Date
    06-04-2015
    Location
    Calgary
    MS-Off Ver
    2013
    Posts
    12

    Re: How to Organize Scraped Data

    Oh you're fast ! I would love to see projects from the different work sheets as rows and information in respective worksheets in columns.

  6. #6
    Forum Expert dflak's Avatar
    Join Date
    11-24-2015
    Location
    North Carolina
    MS-Off Ver
    365
    Posts
    7,920

    Re: How to Organize Scraped Data

    Give me a sample of what you want one of these sheets to look like.

  7. #7
    Registered User
    Join Date
    06-04-2015
    Location
    Calgary
    MS-Off Ver
    2013
    Posts
    12

    Re: How to Organize Scraped Data

    I've color coded the matching information on both work sheets.
    Attached Files Attached Files

  8. #8
    Forum Expert dflak's Avatar
    Join Date
    11-24-2015
    Location
    North Carolina
    MS-Off Ver
    365
    Posts
    7,920

    Re: How to Organize Scraped Data

    I don't see any color coding - all I see is the original data.

  9. #9
    Registered User
    Join Date
    06-04-2015
    Location
    Calgary
    MS-Off Ver
    2013
    Posts
    12

    Re: How to Organize Scraped Data

    My apologies. It's attached now.
    Attached Files Attached Files

  10. #10
    Forum Expert dflak's Avatar
    Join Date
    11-24-2015
    Location
    North Carolina
    MS-Off Ver
    365
    Posts
    7,920

    Re: How to Organize Scraped Data

    This wasn't as easy as I thought it would be. The pages do not have all the same data in exactly the same places. I had to take it in two parts. The first 5 columns of data weren't too bad. I could search for a key word in the source column and parse out the value associated with the keyword and put it in the appropriate cell. The table in the tables tab sets that up.

    The other three columns are keyed off finding the key string "Vintage Year." I loop through the number of years and get the data on those rows.

    Finally, I have a clean up part of the code to fill in the data duplicated in the first 5 columns.

    You had a hidden total column. I eliminated this column. If you need this number, then you can get it using a formula or better still, a pivot table. The data on the demand tab is perfect for a pivot table.

    I am not sure I got all the mappings correct. I took some guesses.
    Attached Files Attached Files

  11. #11
    Registered User
    Join Date
    06-04-2015
    Location
    Calgary
    MS-Off Ver
    2013
    Posts
    12

    Re: How to Organize Scraped Data

    Wow ! You're a genius !

  12. #12
    Forum Expert dflak's Avatar
    Join Date
    11-24-2015
    Location
    North Carolina
    MS-Off Ver
    365
    Posts
    7,920

    Re: How to Organize Scraped Data

    1% inspiration, 99% perspiration - At least you got me to look up the find command

  13. #13
    Registered User
    Join Date
    06-04-2015
    Location
    Calgary
    MS-Off Ver
    2013
    Posts
    12

    Re: How to Organize Scraped Data

    Hello dflak,

    One more favour, i'd like to include a couple more sections to the demand tab. I've highlighted sections in yellow in tab "1". Can you help ? Attached.

    Regards,
    Attached Files Attached Files

  14. #14
    Registered User
    Join Date
    06-04-2015
    Location
    Calgary
    MS-Off Ver
    2013
    Posts
    12

    Re: How to Organize Scraped Data

    Actually, i figured it out. So no need to solve my recent request. Thanks for the great comments with VBA dflak !

+ Reply to Thread

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. Cleaning up Data Scraped From the Web by Deleting Certain Rows
    By torchD. in forum Excel Programming / VBA / Macros
    Replies: 1
    Last Post: 02-20-2015, 10:52 AM
  2. organize data
    By martinez_pedro in forum Excel Programming / VBA / Macros
    Replies: 4
    Last Post: 03-16-2014, 04:57 PM
  3. How To re-organize data
    By Daniel.S in forum Excel Programming / VBA / Macros
    Replies: 4
    Last Post: 03-08-2012, 07:24 PM
  4. Organize data
    By rosef in forum Excel General
    Replies: 1
    Last Post: 11-24-2009, 08:22 PM
  5. How to organize this data?
    By adroadster in forum Excel General
    Replies: 3
    Last Post: 01-11-2009, 05:54 PM
  6. Excel 2007 : How would I organize this data?
    By CaptainGarry in forum Excel General
    Replies: 4
    Last Post: 01-07-2009, 05:49 PM
  7. How do I organize my data in this way
    By CaptainGarry in forum Excel General
    Replies: 13
    Last Post: 01-07-2009, 04:37 PM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Search Engine Friendly URLs by vBSEO 3.6.0 RC 1