I couldn't find this information anywhere on the forum, so I figured i would go ahead and ask.

For the most part, I am a decently proficient VBA user. I have built a web query both through VBA and the query tool before to collect data from tables online. However, I now have about 1000 pages of data and need to collect the same specific pieces of information from each. Three twists: the 1000 specific pages are found through a search, only 20 links are viewable at a time before i have to go to the next page of links from the search, and the search is done on a website where I have to log in before I can perform it.

Does anyone have any idea how I can start doing this? I fear that it will be quite in depth. None of the data that I need to collect is contained in tables. Is there any way that I can use the HTML source code to direct VBA to certain elements, such as the search fields and username and password fields, and eventually the data fields? I have never really tried it before.

Thank you for your help.