+ Reply to Thread
Results 1 to 6 of 6

Scrape webpages

  1. #1
    Registered User
    Join Date
    02-12-2021
    Location
    America
    MS-Off Ver
    2016
    Posts
    38

    Scrape webpages

    Looking to scrape the following webpages as an exercise by following wise owl's youtube video 47.1.


    My code should be nearly identical as the table structures are pretty much the same when examining the html. I would just replace the "table" to "tbody", and it should pick up all the rows. But, it didn't seem to pick up the "tr" tagName when I step through. For referenced video on youtube, please use forward to 1:06:35.

    There are 3 issues in general:
    1) tweaking the TagName "tabble", "tr", "tb", not resulting desirable results
    2) when (1) was able to pick up the title row, unicode result display the Chinese Character as ???
    3) Pagination - probably will need to add another loop to pick up page 3, etc.

    I have tried the IE.Explorer version and XML version of the code, and mainly using the XML version to test different tagnames.

    Thanks in advance for those who can help me learn and make progress.


  2. #2
    Forum Moderator AliGW's Avatar
    Join Date
    08-10-2013
    Location
    Retired in Ipswich, Suffolk, but grew up in Sawley, Derbyshire (England)
    MS-Off Ver
    MS 365 Subscription Insider Beta Channel v. 2404 (Windows 11 22H2 64-bit)
    Posts
    80,780

    Re: Scrape webpages

    Welcome to the forum.

    Who is Wise Owl? Nothing to do with this forum ...

    Please don't expect your helpers to have to search the Internet for a video and then have to watch it just to be able to help you - ain't gonna happen, sorry. And you will need to provide a sample workbook.
    Ali


    Enthusiastic self-taught user of MS Excel who's always learning!
    Don't forget to say "thank you" in your thread to anyone who has offered you help.
    You can reward them by clicking on * Add Reputation below their user name on the left, if you wish.

    Forum Rules (updated August 2023): please read them here.

  3. #3
    Registered User
    Join Date
    02-12-2021
    Location
    America
    MS-Off Ver
    2016
    Posts
    38

    Re: Scrape webpages

    website to be scraped:
    //fsop.caac.gov.cn/g145/CARS/WebSiteQueryServlet?method=loadAircraftConditionsResultPage&enterpriseName=&licenceCode=&partsNumber=&partsName=&ataChaptersection=

    youtube video link:
    youtube.com/watch?v=dShR33CdlY8
    Last edited by AliGW; 02-12-2021 at 01:09 PM. Reason: Links added.

  4. #4
    Registered User
    Join Date
    02-12-2021
    Location
    America
    MS-Off Ver
    2016
    Posts
    38

    Re: Scrape webpages

    I am working to transfer the code to this computer and post it here soon.

  5. #5
    Forum Moderator AliGW's Avatar
    Join Date
    08-10-2013
    Location
    Retired in Ipswich, Suffolk, but grew up in Sawley, Derbyshire (England)
    MS-Off Ver
    MS 365 Subscription Insider Beta Channel v. 2404 (Windows 11 22H2 64-bit)
    Posts
    80,780

    Re: Scrape webpages

    Did you not read what I said? Nobody should have to watch a video to help you.

    Explain what you are trying to do, what you have done so far and what isn't working for you.

  6. #6
    Registered User
    Join Date
    02-12-2021
    Location
    America
    MS-Off Ver
    2016
    Posts
    38

    Re: Scrape webpages

    Please see the attached workbook.
    Module 1: IE.Explore method and XML method (subs)
    Module 2: Process call to process website
    Module 3: Another method to try to scrape the webpage.

    Thanks.
    Attached Files Attached Files

+ Reply to Thread

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. Navigate Multiple Webpages using VBA
    By Catsonheat in forum Excel Programming / VBA / Macros
    Replies: 0
    Last Post: 08-28-2019, 08:59 AM
  2. [SOLVED] Getting webpages to the same width
    By Marvo in forum Excel General
    Replies: 1
    Last Post: 09-23-2018, 04:45 PM
  3. Excel to onedrive to webpages
    By blacktrek in forum Excel General
    Replies: 0
    Last Post: 07-06-2015, 01:37 PM
  4. excel sheets as webpages?
    By mikejones in forum Excel General
    Replies: 4
    Last Post: 02-23-2011, 10:45 AM
  5. Importing webpages
    By oliboys in forum Excel General
    Replies: 0
    Last Post: 06-19-2009, 10:43 AM
  6. Text bar for webpages
    By skatmandu2002 in forum Excel General
    Replies: 0
    Last Post: 07-13-2008, 04:56 PM
  7. Navigate through webpages
    By Mahesh in forum Excel Programming / VBA / Macros
    Replies: 0
    Last Post: 08-03-2006, 07:55 AM

Tags for this Thread

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Search Engine Friendly URLs by vBSEO 3.6.0 RC 1