+ Reply to Thread
Results 1 to 10 of 10

Large data....slow excel performance..!!

  1. #1
    Registered User
    Join Date
    01-06-2009
    Location
    USA
    MS-Off Ver
    Excel 2003
    Posts
    3

    Large data....slow excel performance..!!

    Hi,

    I have a large excel data say about 7 mb. The spreadsheets becomes too slow if I try to edit or even while opening the sheet.

    Is there any way where I can reduce the size or can make the excel functioning more faster????

    Regards,
    Aryaa.

  2. #2
    Forum Expert JBeaucaire's Avatar
    Join Date
    03-21-2004
    Location
    Bakersfield, CA
    MS-Off Ver
    2010, 2016, Office 365
    Posts
    33,492
    Reduce the number of calculations going on. Lots of array formulas and SUMPRODUCT formulas, lots of IF(ISERROR(formula),x,formula) ...these things all take a toll on performance. They're all excellent in small doses, but large data sheets need a better solution.

    To increase speed, you might have to give up on fancier formulas and make the sheet larger by adding helper cells or helper sheets to do some calculations in a more straightforward manner.

    Post up some examples of the heavy-lifting formulas you're using, and I'm sure we can offer some simplification.
    _________________
    Microsoft MVP 2010 - Excel
    Visit: Jerry Beaucaire's Excel Files & Macros

    If you've been given good help, use the icon below to give reputation feedback, it is appreciated.
    Always put your code between code tags. [CODE] your code here [/CODE]

    ?None of us is as good as all of us? - Ray Kroc
    ?Actually, I *am* a rocket scientist.? - JB (little ones count!)

  3. #3
    Forum Guru DonkeyOte's Avatar
    Join Date
    10-22-2008
    Location
    Northumberland, UK
    MS-Off Ver
    O365
    Posts
    21,531
    Whilst I agree with all of prior post I would also add that in big models reducing the prevalence of Volatile functions is of vital importance... common examples being the likes of: TODAY(), NOW(), OFFSET, INDIRECT and even INDEX (when used to return RANGE as opposed to VALUE). Conditional Formats etc are also Volatile.

    For more info. have a read here: http://www.decisionmodels.com/calcsecretsi.htm
    (read the other pages too if performance is vital to you)

  4. #4
    Registered User
    Join Date
    01-06-2009
    Location
    USA
    MS-Off Ver
    Excel 2003
    Posts
    3
    thnx for ur valuable advices..
    but i guess i cant really reduce the formulae since they are all needed..

    There are total 5 sheets and each of them are linked to one another through formulae.
    The first sheet has 45 rows and every alternate row has formula and others have manual entries.
    the second sheet is the list of people whihc are connected to first sheet
    and so on..
    it mite sound confusing...but i really cant reduce any of the formulae...
    is there any other way...i can deal with this problem...

    below is one of the formula from the sheet.

    =COUNTIF('Activity Report-Active'!J2:J803, "25-Nov-08")+COUNTIF('Activity Report-Active'!J2:J803, "26-Nov-08")+COUNTIF('Activity Report-Active'!J2:J803, "27-Nov-08")+COUNTIF('Activity Report-Active'!J2:J803, "28-Nov-08")+COUNTIF('Activity Report-Active'!J2:J803, "01-Dec-08")+COUNTIF('Activity Report-Inactive'!J2:J940, "25-Nov-08")+COUNTIF('Activity Report-Inactive'!J2:J940, "26-Nov-08")+COUNTIF('Activity Report-Inactive'!J2:J940, "27-Nov-08")+COUNTIF('Activity Report-Inactive'!J2:J940, "28-Nov-08")+COUNTIF('Activity Report-Inactive'!J2:J940, "01-Dec-08")

  5. #5
    Valued Forum Contributor Rahul Nagar's Avatar
    Join Date
    09-18-2008
    Location
    nasik
    MS-Off Ver
    Excel 2003
    Posts
    465
    Hello Aryaa,

    We request you to attach a sample file so that we can help you in this.
    __________________
    Regards
    Rahul Nagar
    Founder of www.myshortcutkeys.com.


    If you get the answer of your questions then please click EDIT in your original post then click on GO ADVANCED and set the PREFIX box to SOLVED. It helps everybody! ....
    Also
    If you are satisfied by any members response to your problem please consider using the scales icon top right of thier post to show your appreciation.

  6. #6
    Forum Expert JBeaucaire's Avatar
    Join Date
    03-21-2004
    Location
    Bakersfield, CA
    MS-Off Ver
    2010, 2016, Office 365
    Posts
    33,492
    I can already tell you...that ONE formula you posted registers just under 10,000 calculations. That's ONE cell. How many cells have that formula in it?

    And there's a ton of duplication, the same range being parsed over and over, and then you go back and parse it AGAIN for the same date. Look at the underlined parts here:
    =COUNTIF('Activity Report-Active'!J2:J803, "25-Nov-08")+COUNTIF('Activity Report-Active'!J2:J803, "26-Nov-08")+COUNTIF('Activity Report-Active'!J2:J803, "27-Nov-08")+COUNTIF('Activity Report-Active'!J2:J803, "28-Nov-08")+COUNTIF('Activity Report-Active'!J2:J803, "01-Dec-08")+COUNTIF('Activity Report-Inactive'!J2:J940, "25-Nov-08")+COUNTIF('Activity Report-Inactive'!J2:J940, "26-Nov-08")+COUNTIF('Activity Report-Inactive'!J2:J940, "27-Nov-08")+COUNTIF('Activity Report-Inactive'!J2:J940, "28-Nov-08")+COUNTIF('Activity Report-Inactive'!J2:J940, "01-Dec-08")
    You may need to reconsider some redesign. What if your Activity Report-Active sheet had a column of dates that had already collected the COUNTIF data? Then you could just add those cells in a straight

    =AA1+AA2+AA3, etc...

    You potentially save millions of calculations with this one change.

  7. #7
    Forum Guru DonkeyOte's Avatar
    Join Date
    10-22-2008
    Location
    Northumberland, UK
    MS-Off Ver
    O365
    Posts
    21,531
    Different sheets actually.

    I would agree that the COUNTIF you have can be streamlined but we need to see a sample as has already been suggested. Your countifs can be replaced but we'd need to understand the logic of the dates selected - and why for ex. 29th & 30th Nov are excluded -- presumably because they are non-workdays ?

  8. #8
    Forum Expert JBeaucaire's Avatar
    Join Date
    03-21-2004
    Location
    Bakersfield, CA
    MS-Off Ver
    2010, 2016, Office 365
    Posts
    33,492
    Quote Originally Posted by DonkeyOte View Post
    Different sheets actually.
    Duh....there goes my points for attention to detail.

    Anyway, the number of calcs are still monstrous, and if there are hundreds of these cells, my goodness!

  9. #9
    Registered User
    Join Date
    01-06-2009
    Location
    USA
    MS-Off Ver
    Excel 2003
    Posts
    3
    JBeaucaire , the underline formula are 2 different formulae…the range is the same but the paths or rather the source of the data is from 2 different sheets...

    COUNTIF('Activity Report-Active'!J2:J803, "25-Nov-08")
    COUNTIF('Activity Report-Inactive'!J2:J940, "25-Nov-08")
    So they basically will have 2 different figures....

    Isn’t there something like excel optimization?? Where in u can jus reduce the end size of the spreadsheet just like the way we optimize a large sized image to a very small one..??????

  10. #10
    Forum Expert JBeaucaire's Avatar
    Join Date
    03-21-2004
    Location
    Bakersfield, CA
    MS-Off Ver
    2010, 2016, Office 365
    Posts
    33,492
    Size of the spreadsheet actually isn't the problem. A sheet can be 20mb in size and be structured in a way that that calculations happen quickly. That ONE formula has upwards of 10,000 calculations. Spreadsheet optimization would be to find a way to do those 10,000 calculations ONCE, then let other cells benefit from that completed calculation.

    Putting the same references into cell after cell is the redundancy that you need to try and eliminate now that you're already experiencing the slow down.

+ Reply to Thread

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Tags for this Thread

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Search Engine Friendly URLs by vBSEO 3.6.0 RC 1