Power query import based on specific row

Hi All,

I need to load log files which have junk in the first 4 lines, when i try and import via power query it doesnt detect all columns because its looking at those top rows. I only see Data Type Detection = 'based on first 200 rows', 'on the entire data set' or 'dont detect datasets'. None of these options work for me. I have to open the log file in a text editor and delete the lines causing the problem.

is there a way to do this based on a specific row or set of rows, anything after those first 4 lines would help me out i think

thanks!

Hi Team, any ideas about this one?

Hi Rorya,

See attached. This should have an extension of .log but i couldnt upload that for some reason. If you use the data import from text file wizard i would usually import from row 4, then delete the 'fields' cell and everything would be lined up and looking right.

I have a bunch of these files with hundreds of thousands of rows, i wanted to be able to load them all as they are (without removing the stuff i dont need at the top (ie. everything below). Ideally i wanted to load it into the data model so I could summarize and pivot the data for some reports. Its not only more work to import the files but due to thier size i will quickly hit the 1 million row limit if i do that it that way so breaking it up into multiple sheets and then aggregating the data is also not a great way of doing it.

Thanks!


#Software: Microsoft Internet Information Services 8.5
#Version: 1.0
#Date: 2021-05-10 00:00:03
#Fields:

Thanks Rorya, yes that's right, i can manually remove them but i have to do this for a large number of files so was wondering if there's a way to configure that during the import, either when you import the data physically or when you import into the data model using powerquery (or some other function i'm not familiar with)