Log in to webpage using XMLHTTP and scrape table

Hi Guys,

For a long time I've been working on getting info from webpages using InternetExplorer.Application and navigating through the tables to get what I wont. However, there are plenty of webpages that no longer support internet exporer, so I need to find new ways to extract the data.

I've been playing around lately with XMLHTTP and startet out by scraping swap-rates (https://seb.se/pow/apps/swaprates/default.aspx) wich isn't password protected. I'm now trying to use the same method (with some minor tweaks) to get information from another table on another website which is password protected. I've been searching to web to find any solution, but I can't find any answers. As far as I can see, I think the problem lies on the log-in.

Is there any way to tweak my code to fix my problem?

Se attached code and also part of the HTML code to the login-page.

Please Login or Register  to view this content.

Skjermbilde.PNG


For referance, this is my working code to get the swap-data from SEB.

Please Login or Register  to view this content.

Not much help as we could not see the source page.

Use "Post", instead of "GET"

But the most important are the parameters. I can't remember the way or short cut to get them, but there are somewhere within the source code.

.Open "POST", "https://www.autocheck.co.uk/", False

Hi again and thanks for your answer AB33,

Originally, I tried to use the code underneath to fetch a known element (Sheet1.Range("B5").text) behind the password protected site. Just to test if the "log in" part of the code is working. However, it doesn't seem like I'm getting past the log in. I've tried to post an image of the source code on the log in page but is there any other information you need?

The page I'm trying to log in to is a portfolio management system which you can only access from the network on my office. However, the problem remains the same for other sites. I've tried to implement to code on another webpage: https://www.nordnet.no/login-next to fetch a table witch contains my stock portfolio. This is one of tyhe webpages that noe longer supports Internet Explorer.

Please Login or Register  to view this content.

Unfortunately, I forget the key combination short cuts to view the HTML pages, not the source inspect code. I have not used them for over two years

.send "DisplayVrm=123456"

You should use "Post", not "Get".
On the HTML page (I forget how to access it now), you see parameters. They are in pairs: Name and value. In your case, the user name and password should have values. For instance, DisplayVrm is the parameter name and value is 123456.
In my experience, if the site does not display or give you the parameters, you can't access it.

Okay! I have V got it . After opening (Right click and then "View page source", hit F12, it takes you to a different pages with menus bars