Beginner question about scraping web pages with Excel VBA

Hello everyone,

I'm trying to do the following:

1. Visit a website
2. Fill out an input box
3. Click Submit
4. Scrape text from the resulting webpage

I've pasted my current code at the end of this post. For some reason, that last htmlDoc.body.innerHTML shows the body of the first webpage, not the new webpage after the submit button was clicked. I assumed that by saying Set htmlDoc = objIE.Document after clicking submit, it sets htmlDoc as the new active webpage, so when I grab the body text, it should grab the text from the second page, no?

I'm really new to all this, so if anyone has a link to a primer on scraping data from web pages with Excel, it would be greatly appreciated as well.

Please Login or Register  to view this content.