+ Reply to Thread
Results 1 to 4 of 4

Handling large data sets

  1. #1
    Registered User
    Join Date
    08-12-2013
    Location
    Israel
    MS-Off Ver
    Excel 2003
    Posts
    58

    Handling large data sets

    Hello,
    I have a macro that manipulates potentially large data files that can occasionally clog the computer's memory (I use a certain amount of traffic between sheets and variants as well as multiple sheet formulas).
    I am trying to find ways to identify and handle such cases on the fly. Specifically, I have encountered the problem that once I get an "out of memory" error, I can't do anything other than restarting Excel (if I stop the macro and run it again without closing Excel, I get the "out of memory" error sooner than on the previous attempt).
    I am looking for a solution along the following lines:
    - see what variables are actually being used at a given moment (in debugging mode) so I can determine if I need to clear any of them (I have many variables with various scopes, so it's hard to check them manually one by one)
    - clear the memory after getting the "out of memory" error (so I can recover from this error dynamically and partition the data until it's small enough to handle).

    Any suggestions?
    Thanks,
    Chen

  2. #2
    Forum Expert dflak's Avatar
    Join Date
    11-24-2015
    Location
    North Carolina
    MS-Off Ver
    365
    Posts
    7,920

    Re: Handling large data sets

    You may consider clearing the clipboard when you know you don't need the contents. If you just pasted data, try this after the paste command:
    Please Login or Register  to view this content.
    Otherwise you can clear the windows clipboard. I found this piece of code using a web search
    Please Login or Register  to view this content.
    One spreadsheet to rule them all. One spreadsheet to find them. One spreadsheet to bring them all and at corporate, bind them.

    A picture is worth a thousand words, but a sample spreadsheet is more likely to be worked on.

  3. #3
    Registered User
    Join Date
    08-12-2013
    Location
    Israel
    MS-Off Ver
    Excel 2003
    Posts
    58

    Re: Handling large data sets

    Great, thanks!

  4. #4
    Registered User
    Join Date
    08-12-2013
    Location
    Israel
    MS-Off Ver
    Excel 2003
    Posts
    58

    Re: Handling large data sets

    Actually, my problem is not with the clipboard but with arrays.
    Occasionally when I try to load a large amount of data from a worksheet into a variant I get an "Out of memory" error. Is there a way to clear the memory or calculate beforehand how much data I can load without exhausting the computer's resources?

+ Reply to Thread

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. Handling large data sets in excel
    By hhhjjj in forum Excel Programming / VBA / Macros
    Replies: 1
    Last Post: 02-27-2017, 08:27 AM
  2. [SOLVED] Handling Duplicate Entries with Index/Match/Large in Column Data
    By TwiceBorn in forum Excel Formulas & Functions
    Replies: 7
    Last Post: 08-12-2016, 02:11 PM
  3. Beginner needs guidance for large data handling
    By kappyb in forum Excel General
    Replies: 2
    Last Post: 03-21-2015, 08:22 AM
  4. Combining large sets of data
    By cab0317 in forum Excel General
    Replies: 9
    Last Post: 10-02-2013, 12:50 PM
  5. Working with large sets of data
    By Bishonen in forum Excel Programming / VBA / Macros
    Replies: 1
    Last Post: 09-11-2013, 06:19 AM
  6. interrogating large data sets
    By ruleworld in forum Excel General
    Replies: 1
    Last Post: 01-04-2011, 07:13 AM
  7. Large Form Help: Handling large number of text boxes and labels
    By laterdaysluke in forum Excel Programming / VBA / Macros
    Replies: 2
    Last Post: 10-01-2010, 03:12 PM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Search Engine Friendly URLs by vBSEO 3.6.0 RC 1