+ Reply to Thread
Results 1 to 2 of 2

Problems scraping javascript web page

  1. #1
    Registered User
    Join Date
    03-17-2019
    Location
    Australia
    MS-Off Ver
    2010
    Posts
    3

    Problems scraping javascript web page

    Hi,
    Forum newbie but been using VBA for many years. Relevant to the question, my javascript knowledge is near enough to nil.

    {https link} telstra-nbn.speedtestcustom.com/
    I use CreateObject("InternetExplorer.Application") to successfully open the above link in an Window then objIE.Document.getElementsByClassName(btn)(0). Click to run the javascript that does a speedtest. when it completes, the result displays on a refreshed web page with a new URL. Example:
    {https link} telstra-nbn.speedtestcustom.com/result/fe2f9010-48f8-11e9-b436-77ca21305a44

    I tried scraping using Data query but that gives me a script error (citing URL {https link} c.speedtestcustom.com/static/js/testBundle.js?v=1551736639632 for the link immediately above). If I continue running, I get an error reporting no data.

    Does anyone have a workaround for the problem? Dumping data from the open web page to sheet seems most attractive but I don't know how to do that. Maybe HTML method but I only have table experience using that. Data don't seem to be in table format and I don;t know how to dump the entire content to sheet where I am sure Find would help extract what I need.

    Sorry about the slightly obfuscated links. Forum rules say I am not permitted to post web links.

  2. #2
    Registered User
    Join Date
    03-17-2019
    Location
    Australia
    MS-Off Ver
    2010
    Posts
    3

    Re: Problems scraping javascript web page

    While I would appreciate a more elegant solution, I worked around the issue for now using SendKeys. The method may help someone else trying to work with javascript results in a web page.

    Please Login or Register  to view this content.

+ Reply to Thread

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. VBA scraping web page data
    By guloomet in forum Excel Programming / VBA / Macros
    Replies: 0
    Last Post: 11-08-2016, 05:00 AM
  2. how scraping javascript web
    By davide2574 in forum Excel Programming / VBA / Macros
    Replies: 0
    Last Post: 11-11-2015, 04:49 AM
  3. Activate a web page from multiple tabs to be able to executes javascript functions
    By rs585832 in forum Excel Programming / VBA / Macros
    Replies: 2
    Last Post: 02-22-2013, 11:56 AM
  4. ie.ExecWB OLECMDID_SELECTALL command on page with JavaScript
    By kaocko in forum Excel Programming / VBA / Macros
    Replies: 0
    Last Post: 02-04-2013, 06:23 AM
  5. vba activate javascript input box on web page
    By fly4u in forum Excel Programming / VBA / Macros
    Replies: 0
    Last Post: 10-02-2011, 07:13 AM
  6. Writing from Excel to Javascript Web Page
    By prescient in forum Excel Programming / VBA / Macros
    Replies: 0
    Last Post: 03-31-2009, 10:16 AM
  7. javascript causing web query problems
    By TonyH. in forum Excel Programming / VBA / Macros
    Replies: 2
    Last Post: 11-03-2005, 01:15 AM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Search Engine Friendly URLs by vBSEO 3.6.0 RC 1