+ Reply to Thread
Results 1 to 2 of 2

Working with large data sets and multiple criteria

  1. #1
    Valued Forum Contributor Sean Thomas's Avatar
    Join Date
    03-25-2012
    Location
    HerneBay, Kent, UK
    MS-Off Ver
    Excel 2007,2016
    Posts
    971

    Working with large data sets and multiple criteria

    Hi all,
    I'm just after a few ideas to speed up calculations.

    I have a data set of approximately 25 columns, 50000 rows. Ranging over 13 months.
    There is a dashboard that has 20 dropdown boxes. These have between 3 and 200 options per drop down.
    After the user makes the selections the calculations pull back 10 values per each month and 10 values for the last 4 weeks
    These are then used to populate a stacked column chart.

    I originally used sumifs & countifs formulas, but due to an issue with numbers I ended up using array formulas.
    With a smaller set of data everything is fine but 50000 rows and its taking about 7 seconds to calculate.
    I have even used dynamic ranges on all the columns to reduce the data set its looking at.

    I have also looked into using ADO to extract the data, but that takes even longer.

    Usually for dashboards I have a data set for various measures based on month and weeks and therefore just do look ups. But due to the amount of variables possible from the dropdowns the data sets would be endless.
    So I am stuck with calculating the data every time a selection is changed.

    The report originally had a sheet for each month and week, with helper columns to check if values matched the dashboard selections. then a sumif formula was used to lookup a value produced by the dropdown selections to find matches in the helper columns.
    This was ok but there was also about a 7 second calculation and the file was over 300MB using xls. Using xlsx its about 17mb.

    Unfortunately I cannot upload the file as its for work and contains sensitive data.

    Has anyone got any suggestions to speed up calculation, or is this going to be my best option due to the amount of selections required.
    Regards
    Sean

    Please add to my reputation if you think i helped
    (click on the star below the post)
    Mark threads as "Solved" if you have your answer
    (Thread Tools->Mark thread as Solved)
    Use code tags when posting your VBA code:
    [code] Your code here [code]
    Please supply a workbook containing example Data:
    It makes its easier to answer your problem & saves time!

  2. #2
    Forum Moderator - RIP Richard Buttrey's Avatar
    Join Date
    01-14-2008
    Location
    Stockton Heath, Cheshire, UK
    MS-Off Ver
    Office 365, Excel for Windows 2010 & Excel for Mac
    Posts
    29,464

    Re: Working with large data sets and multiple criteria

    Have you considered a Pivot Table and its associated Pivot Chart along with Slicers?

    Anonymise a subset of your workbook, we don't need to see zillions of rows and upload that as a file. Include an example of what you expect the result to look like.
    Richard Buttrey

    RIP - d. 06/10/2022

    If any of the responses have helped then please consider rating them by clicking the small star icon below the post.

+ Reply to Thread

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. Replies: 12
    Last Post: 01-27-2017, 12:23 PM
  2. My Excel Knowledge is very poor and working for large data sets in new job
    By mukeshsinha in forum Hello..Introduce yourself
    Replies: 1
    Last Post: 10-21-2014, 05:20 PM
  3. Multiple crashes of Excel for Mac 2011 with large data sets
    By mskumar1512 in forum For Other Platforms(Mac, Google Docs, Mobile OS etc)
    Replies: 0
    Last Post: 07-29-2014, 08:40 PM
  4. Problems adding large amounts of data with multiple criteria
    By jcroque89 in forum Excel Formulas & Functions
    Replies: 4
    Last Post: 06-12-2014, 12:15 PM
  5. Plotting Multiple and Large Data sets on a clustered column chart
    By spuri78 in forum Excel Charting & Pivots
    Replies: 7
    Last Post: 01-01-2014, 09:14 AM
  6. Working with large sets of data
    By Bishonen in forum Excel Programming / VBA / Macros
    Replies: 1
    Last Post: 09-11-2013, 06:19 AM
  7. Counting data sets based on multiple criteria
    By hjb0802 in forum Excel Formulas & Functions
    Replies: 5
    Last Post: 04-29-2010, 10:47 AM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Search Engine Friendly URLs by vBSEO 3.6.0 RC 1