Very Large Data Sets - Deleting Rows

[MrRhodes2004]

Hey Group,

It has been a while. Hope this is an easy question.

I am now working with very large datasets of almost 50,000 rows and 40+ columns of data per worksheet with a dozen worksheets in the workbook. The data is weather information taken at every minute of the day. Each worksheet is a month of data. I am trying analyze the data but that is taking a tremendous amount of time. Therefore, I am trying to reduce the minute information to an average hourly information.

With some help, I am using the code below (which is much better than the code I had been using for a long time).

In column A I have created an identifier to provide an * if the data is not required and blank if it is. Then I run the code to find those rows and delete them. However, with almost 50000 rows of data, it is very time consuming. The end result is around 800 rows.

First, is there a better way to work with so much data without deleting portions of the whole data?
Second, the code below works but takes a long amount of time. Is there a more efficient way?

Please Login or Register  to view this content.

[kosherboy]

Add the below code to a module:

Please Login or Register  to view this content.

...then call OptimizeCode_Begin in the beginning of your code, and at the end of your code call OptimizeCode_End

Hope this does something

[TMS]

If the identifier in column A is based on a formula, why not just use Autofilter based on the conditions in that formula? Or just filter on column A and delete visible rows.

[Akuini]

I agree with Trevor, it can be done without using VBA.
But if you need vba, this one might do the job.
Try this:
The output is in sheet2

Please Login or Register  to view this content.

[MrRhodes2004]

This was helpful. Thank you