+ Reply to Thread
Results 1 to 9 of 9

Web Scraper Function Vessels data

  1. #1
    Registered User
    Join Date
    07-31-2015
    Location
    Amsterdam,Netherlands
    MS-Off Ver
    2010
    Posts
    8

    Web Scraper Function Vessels data

    Hi all,

    I want extract some data from multiple webpages several time a day. I already tried some things, but can't get it to extract the proper data. I want to do the following:
    Extract the Latitude / Longitude from for example the following vessel: http://www.marinetraffic.com/en/ais/...:SEISHU%20MARU

    I want to do this for all LNG vessels several time a day. Does anyone have a tip on how to do this with a fast working function/macro.

    Thanks in advance

  2. #2
    Forum Guru Kyle123's Avatar
    Join Date
    03-10-2010
    Location
    Leeds
    MS-Off Ver
    365 Win 11
    Posts
    7,238

    Re: Web Scraper Function Vessels data

    The website has a subscription API service, so that will likely be much easier to use. Have you looked into that?

  3. #3
    Registered User
    Join Date
    07-31-2015
    Location
    Amsterdam,Netherlands
    MS-Off Ver
    2010
    Posts
    8

    Re: Web Scraper Function Vessels data

    Yes I did, but it's for a study project and I don't have the resources to pay for the subscription. And I thought it might be a cool project to automate it from one excel sheet.

  4. #4
    Forum Guru Kyle123's Avatar
    Join Date
    03-10-2010
    Location
    Leeds
    MS-Off Ver
    365 Win 11
    Posts
    7,238

    Re: Web Scraper Function Vessels data

    Do you have the urls for all the ships you want to track?

  5. #5
    Registered User
    Join Date
    07-31-2015
    Location
    Amsterdam,Netherlands
    MS-Off Ver
    2010
    Posts
    8

    Re: Web Scraper Function Vessels data

    Yes.
    My initial plan was to put all the URL's (400 in total) or the last part of the URL that changes, in for example column A. Than with a function set a formula in column B that refers to A and extract the Latitude / Longitude value from the page.
    But I don't know how to build this function. Any ideas?

  6. #6
    Forum Guru Kyle123's Avatar
    Join Date
    03-10-2010
    Location
    Leeds
    MS-Off Ver
    365 Win 11
    Posts
    7,238

    Re: Web Scraper Function Vessels data

    You probably wouldn't do it like that. Could you upload a workbook with your links in please?

    How To:

    Make sure there is just enough data to demonstrate your need. Include a BEFORE sheet and an AFTER sheet in the workbook if needed to show the process you're trying to complete or automate. Make sure your desired results are shown, mock them up manually if necessary.

    Remember to desensitize the data.

    Click on GO ADVANCED and use the paperclip icon to open the upload window.

    View Pic

  7. #7
    Registered User
    Join Date
    07-31-2015
    Location
    Amsterdam,Netherlands
    MS-Off Ver
    2010
    Posts
    8

    Re: Web Scraper Function Vessels data


  8. #8
    Forum Guru Kyle123's Avatar
    Join Date
    03-10-2010
    Location
    Leeds
    MS-Off Ver
    365 Win 11
    Posts
    7,238

    Re: Web Scraper Function Vessels data

    This'll work (ish), the range will need changing accordingly, you'll also find that sometimes it doesn't work - I think the site are limiting request in a short period to prevent automated scraping

    Please Login or Register  to view this content.
    End Sub

  9. #9
    Registered User
    Join Date
    07-31-2015
    Location
    Amsterdam,Netherlands
    MS-Off Ver
    2010
    Posts
    8

    Re: Web Scraper Function Vessels data

    Hi Kyle! works like a charm! Thanks!!

+ Reply to Thread

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. Web scraper - Parameter value
    By Jollyfrog in forum Excel Programming / VBA / Macros
    Replies: 1
    Last Post: 02-28-2022, 05:01 PM
  2. Data Scraper
    By MotionEyes in forum Excel General
    Replies: 3
    Last Post: 05-24-2015, 02:41 PM
  3. index function error using match function to get data from a cell in an array
    By mabildgaard in forum Excel Formulas & Functions
    Replies: 4
    Last Post: 10-17-2013, 02:21 AM
  4. Scraper working with IE9 but not IE10 (Mid VBA?)
    By mattmc419 in forum Excel Programming / VBA / Macros
    Replies: 2
    Last Post: 10-16-2013, 10:54 PM
  5. [SOLVED] How to collect data with web scraper ?
    By Carly Fiorina in forum Excel General
    Replies: 7
    Last Post: 03-13-2013, 05:04 AM
  6. VBA Internet Scraper on a chart w/ multiple selections
    By finwiz in forum Excel Programming / VBA / Macros
    Replies: 0
    Last Post: 09-04-2012, 03:16 PM
  7. Help modifying someone else's VBA screen scraper
    By DublinMeUp in forum Excel Programming / VBA / Macros
    Replies: 1
    Last Post: 08-03-2012, 06:08 AM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Search Engine Friendly URLs by vBSEO 3.6.0 RC 1