+ Reply to Thread
Results 1 to 8 of 8

Scraping website into excel

  1. #1
    Registered User
    Join Date
    07-07-2014
    Location
    las vegas, nv
    MS-Off Ver
    2007
    Posts
    8

    Scraping website into excel

    I have an excel sheet that has a lot of APN (parcel numbers) on it. I would like to run that through the assessors page http://www.clarkcountynv.gov/Depts/a...lprop/pcl.aspx to get the address and owners name. It seems like a very simple thing to do, but... How would I make it run each parcel through the assessors page to get the name and address information. Is there a tool I can install into Excel to make this easier? I don't have code experience

  2. #2
    Forum Expert
    Join Date
    10-09-2012
    Location
    Dallas, Texas
    MS-Off Ver
    MO 2010 & 2013
    Posts
    3,049

    Re: Scraping website into excel

    Power Query (used to be data explorer)

    http://datapigtechnologies.com/blog/...data-explorer/
    Please ensure you mark your thread as Solved once it is. Click here to see how.
    If a post helps, please don't forget to add to our reputation by clicking the star icon in the bottom left-hand corner of a post.

  3. #3
    Registered User
    Join Date
    07-07-2014
    Location
    las vegas, nv
    MS-Off Ver
    2007
    Posts
    8

    Re: Scraping website into excel

    Thank you, I've been spending a lot of time researching power query. I've just finished installing office 2010 (I was using an older version). I'm hoping that when I actually start playing with it, some of these things will make more sense. I have a long list of different APN numbers. I would need to run each on individually to get the data I want for each property. Have you actually used Power Query before and do you know if that's possible? I wish you were in Las Vegas, I would just pay you to help me with this ><.

  4. #4
    Registered User
    Join Date
    07-07-2014
    Location
    las vegas, nv
    MS-Off Ver
    2007
    Posts
    8

    Re: Scraping website into excel

    My problem is, when you put in an APN at this link http://www.clarkcountynv.gov/Depts/a...lprop/pcl.aspx , its the exact same link for every different APN. There's got to be some kind of setting I have to change instead of just the standard "From Web". Maybe change the Data Source Settings? I can't get it to import the data for a give APN at all. If you type in an APN like 177-10-310-154 for example, it gives you a ton of info. I only want 5 or 6 fields or so from each APN. When you type another APN like 138-28-115-003, its a completely different set of info, but with the same URL.

  5. #5
    Forum Expert
    Join Date
    11-24-2013
    Location
    Paris, France
    MS-Off Ver
    Excel 2003 / 2010
    Posts
    9,831

    Re: Scraping website into excel


    You have to pilot Internet Explorer with this kind of static URL.

    See examples in threads of this forum and all over the Web !

    If you don't have any basics in HTML webpage structure, want to save time and nerves :
    try commercial services …
    Last edited by Marc L; 07-11-2014 at 10:21 AM. Reason: misspelling …

  6. #6
    Registered User
    Join Date
    07-07-2014
    Location
    las vegas, nv
    MS-Off Ver
    2007
    Posts
    8

    Re: Scraping website into excel

    Sorry for the Bad Etiquette with the double posts. I actually know better. After learning about the power query, it changed my question so much I thought it warranted a new post. I appreciate you pointing me in the right direction, and I will at some point hire someone to help; after I feel like I know enough to not be taken advantage of again. I've always had trouble trying to explain how I wanted this to work, and every IT guy thinks they have a better solution than what I had in mind. I originally had all the data pulled into MySQL, then from there it would go into excel. My old system was for buying properties at auction, which I don't do so much anymore because of how the market changed. I had 2 full time IT guys that I paid $1,000/week. That was fine at the time, because in 2008 the auction was so crazy and things changed so fast, I needed a full time IT staff. Before, I needed to scrape a lot of different sites to get opening bids, postponements, cancelations, from trustee websites. I also scraped the assessor’s page to get the property info such as sqft, beds, bath, subdivision, etc., and I would scape another site to get the auction list for the day. It would compile all of that data into one big spread sheet, and when a trustee added an opening bid, or a postponement or cancelation during the auction, my spreadsheet would change almost immediately. Now there are a lot of service providers like foreclosureradar.com that provide the exact same data for like $50/m, so I will probably never have to go back to the old way. You can’t really maintain software like that without a full time IT staff, because one of the 30 sites or so you’re scraping from will change, and you will need someone to fix your code constantly.
    Right now I’m doing something much simpler. I’m buying from the notice of default list. I can export the NOD list from the recorders website into a .csv format. I have macros that filter out the unwanted stuff, but I have to manually gather much of the other information I need from 5 or 6 sites.
    IMI INVESTMENTS LLC NEVADA TITLE COMPANY 3/28/2014 8:00 176-13-412-008
    CLEAR RECON CORP SALAS, PEDRO R 3/27/2014 15:51 139-24-810-091
    FIRST AMERICAN TITLE INSURANCE COMPANY VELAZQUES, EDGARDO 3/27/2014 14:48 162-21-314-002
    SPANGLER, SEAN CLEAR RECON CORP 3/27/2014 14:39 137-35-114-007
    STEPTEAU, MARLON C TIERRA DE LAS PALMAS OA 3/27/2014 13:55 124-32-814-002
    MCDONALD, RUFUS L QUALITY LOAN SERVICE CORPORATION 3/27/2014 13:44 138-33-317-041
    MOUSA, JENAN QUALITY LOAN SERVICE CORPORATION 3/27/2014 13:44 140-28-110-013
    KOURY, MICHAEL P QUALITY LOAN SERVICE CORPORATION 3/27/2014 13:44 179-08-715-024

    This is a small example of the data I have export to excel on a daily basis. Right now I have to go to 5 or 6 different sites to get the rest of the info I need for each property. I’m trying to start with my biggest waste of time 1st, and that’s the assessors information. Every day I will have 40-50 different APN numbers to run through the assessors page to gather maybe 7 different pieces of information(beds, bath, subdivision ect). Once I can get this to work, I will try to automate my next biggest time waster. At some point I will hire someone to come in and finish this off and make it nice and polished, but I want the foundation already laid.

  7. #7
    Forum Expert
    Join Date
    11-24-2013
    Location
    Paris, France
    MS-Off Ver
    Excel 2003 / 2010
    Posts
    9,831

    Re: Scraping website into excel


    The better explanations are the better code is !

    Best is to join a sample workbook with a before worksheet and a desired result worksheet,
    two AP numbers are enough if it's always the same data to import from the web page.

    Looks not difficult but without knowing exactly what you are expecting …

  8. #8
    Forum Expert
    Join Date
    11-24-2013
    Location
    Paris, France
    MS-Off Ver
    Excel 2003 / 2010
    Posts
    9,831

    Lightbulb Re: Scraping website into excel


    See this thread !

    Use inspector tool within your web browser to see web page elements …

+ Reply to Thread

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. Scraping Data from Web Into Excel Using VBA
    By gurs in forum Excel Programming / VBA / Macros
    Replies: 16
    Last Post: 01-31-2015, 06:26 PM
  2. Replies: 1
    Last Post: 02-17-2014, 11:21 PM
  3. Scraping website data when Get External Data from Web doesnt work
    By Zipping2010 in forum Excel Programming / VBA / Macros
    Replies: 1
    Last Post: 02-01-2013, 12:16 AM
  4. scraping data from a website
    By redpanda in forum Excel Programming / VBA / Macros
    Replies: 9
    Last Post: 07-05-2012, 01:20 PM
  5. Scraping website data into Excel
    By oliver79 in forum Excel General
    Replies: 0
    Last Post: 06-13-2010, 02:15 PM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Search Engine Friendly URLs by vBSEO 3.6.0 RC 1