VBA: Importing more than 1 miliion Rows of Data from Websiite (Multiple Tabs)

[geniusufo007]

at the following website
https://oec.world/en/resources/data/
there is a file namely "year_origin_sitc_rev2", the extension of this file is TSV when i import this file by using DATA/FROM TEXT, it does not extract the complete file becasue the rows are more than 1 MLN, how do i extract it, the file must be completely extracted, the size of the file is 67 MB (rar file) actual size is 243 MB TSV

[AliGW]

Excel can support up to 1,048,576 rows. If it's more than that, you can't.

If you can get the data out into a .txt file, then you may be able to import it into multiple tabs.

[geniusufo007]

Thanks AliGW, I'm opening in notepad but it is taking too much time, is there any macro which take the data from the file and import in different sheets by using DATA/TEXT FROM

[AliGW]

Possibly - I'll move this to the VBA section so that our VBA experts will see it.

[geniusufo007]

Thanks once again

[Marc L]

is there any macro which take the data from the file and import in different sheets by using DATA/TEXT FROM

Explain at least what is your criteria to cut data to different sheets …

Why Excel ? As there is no limit using a database software which runs at least 50 times faster than Excel !

[Haluk]

@geniusufo007;

There is an API section which gives some data in JSon format.

https://oec.world/api/

May be you can use one of the API calls to get data, which is more easy then downloading that huge file and fetch the data.

Example:

https://oec.world/hs92/export/2010/usa/all/show/

.

[scottiex]

Chip Pearson's site has some code to import large text files that you could try.

http://www.cpearson.com/excel/ImportBigFiles.aspx

[geniusufo007]

Thanks all and let me check

[Marc L]

In fact all can be imported within a single worksheet but as it depends on the layout you want …