+ Reply to Thread
Results 1 to 13 of 13

Why is my Excel file so big even though I uploaded the data using Power Pivot/Power Query?

  1. #1
    Registered User
    Join Date
    09-18-2023
    Location
    Frankfurt, Germany
    MS-Off Ver
    Version 16.77
    Posts
    7

    Why is my Excel file so big even though I uploaded the data using Power Pivot/Power Query?

    Hi Excel-community,

    a friend and I are currently working on a Dashboard. The data set is very large which is why she uploaded the data using Power Query. If I understand correctly, by doing so, the data set is comprimised (please correct me if I am wrong) and it should not be a problem to build a Dashboard with about one million rows.

    When I started building the Dashboard (which mainly includes making simple pivot tables in a backlog and based on those using data slicers to create diagrams in a different sheet), the file started to become slower and slower. I just checked how large the file is (184MB) which I think is too big. My concrete questions are the following:

    Is it normal that a file with 184MB is so slow (slow=selecting a different filter takes 40 seconds)?
    Is it possible that it became so large because of all the filters I inserted or should that not be a problem? (the data set is just one table and not connected with other add-ins)?
    What is the most problematic: Creating more and more Pivot tables (using the same set of data), using data sclicers (=filters) or including diagrams based on the pivot tables and slicers?
    How comprimised should the data be after uploading it? (Original data: 110MB)?
    What would you suggest I should do as a next step?

    I would be very greatful for any tips & tricks, please don't hesitate to ask questions if I haven't explained well enough.

    Best regards Olivia

    This Dashboard has already been built for parts of the data, I wanted to build one big Dashboard including all of the data. Since we uploaded it with power pivot, we expected it to be faster than before (previously with the other Dashboards we did not use Power pivot/Query), but it is as slow as before.

  2. #2
    Forum Expert romperstomper's Avatar
    Join Date
    08-13-2008
    Location
    East Sussex, UK
    MS-Off Ver
    365, varying versions/builds
    Posts
    21,297

    Re: Why is my Excel file so big even though I uploaded the data using Power Pivot/Power Qu

    184MB is pretty big considering that's a compressed folder.

    I'd suggest you make a copy of the file, add a blank sheet, then delete all the other sheets one by one, saving after each one, to see if the file size changes significantly. I'm assuming you don't know how big the file was originally with just the data query and no pivot tables/charts (is that what you mean by diagrams?) built yet?
    Remember what the dormouse said
    Feed your head

  3. #3
    Forum Expert Logit's Avatar
    Join Date
    12-23-2012
    Location
    North Carolina
    MS-Off Ver
    Excel 2019 Professional Plus - 2007 Enterprise
    Posts
    7,015

    Re: Why is my Excel file so big even though I uploaded the data using Power Pivot/Power Qu

    Sometimes Excel will create thousands of lines of non-descript data that cannot be seen but is located in all the blank rows after the last visible row on each sheet in the workbook.

    You can manually go to each sheet highlight all those blank rows and press DELETE or you can run the following macro to automate the process for you.

    RUN THIS MACRO ON A COPY OF YOUR WORKBOOK FIRST, THEN CHECK THE FILE SIZE. IF THE SIZE HAS BEEN REDUCED AND THE WORKBOOK STILL FUNCTIONS AS DESIGNED,
    RUN THE MACRO ON YOUR ORIGINAL WORKBOOK.


    Please Login or Register  to view this content.

  4. #4
    Registered User
    Join Date
    09-18-2023
    Location
    Frankfurt, Germany
    MS-Off Ver
    Version 16.77
    Posts
    7

    Re: Why is my Excel file so big even though I uploaded the data using Power Pivot/Power Qu

    Hello Logit,

    thank you for this hint. I deleted all irrelevant rows as you suggested manually (because there are only three sheets in my file), but the file size hasn't changed.

  5. #5
    Registered User
    Join Date
    09-18-2023
    Location
    Frankfurt, Germany
    MS-Off Ver
    Version 16.77
    Posts
    7

    Re: Why is my Excel file so big even though I uploaded the data using Power Pivot/Power Qu

    Thank you for the suggestion Rorya. I do not know how big the file was with just the data query, but I regenerated it. Like I said, the original data is 110MB, but when I imported it using data query it was still about 90MB big. Does that already sound weird to you?

    Also, I tried deleting sheet after sheet, and after deleting the sheets with the charts (yes, that's what I meant by diagrams), the file was 10MB bigger than before! How is that possible? Something is really weird here.

    Best regards
    Olivia

  6. #6
    Registered User
    Join Date
    09-18-2023
    Location
    Frankfurt, Germany
    MS-Off Ver
    Version 16.77
    Posts
    7

    Re: Why is my Excel file so big even though I uploaded the data using Power Pivot/Power Qu

    Actually, I think I might know what went wrong with the upload (which still does not explain why it became so big with the Dashboard): I used Power query, but not "connection only" to import the data. I think I had to do that, correct?

    The problem is, I am using a Mac & can't find the box where I can choose "connection only" while importing data using power query. Do you know if it is possible, or is there a problem with Mac again?

    Best regards and thanks in advance
    Olivia

  7. #7
    Forum Expert romperstomper's Avatar
    Join Date
    08-13-2008
    Location
    East Sussex, UK
    MS-Off Ver
    365, varying versions/builds
    Posts
    21,297

    Re: Why is my Excel file so big even though I uploaded the data using Power Pivot/Power Qu

    If you are on a Mac, you are not using Power Pivot, because you can't use the data model. You also can't set up a connection only query, so all your data is in a table which would explain the file size issues.

  8. #8
    Registered User
    Join Date
    09-18-2023
    Location
    Frankfurt, Germany
    MS-Off Ver
    Version 16.77
    Posts
    7

    Re: Why is my Excel file so big even though I uploaded the data using Power Pivot/Power Qu

    Thank you, that is it. But since someone else uploaded it using Power Query with "connection only" (and using a Windows), did I technically "brake" the file by opening it with my mac? Is that possible? Because apparently, before I opened it, the data was imported correctly without seeing a table. But when I opened the file with my mac, I was able to see the table with the data.

  9. #9
    Forum Expert romperstomper's Avatar
    Join Date
    08-13-2008
    Location
    East Sussex, UK
    MS-Off Ver
    365, varying versions/builds
    Posts
    21,297

    Re: Why is my Excel file so big even though I uploaded the data using Power Pivot/Power Qu

    I couldn't say whether that is normal as I've never tested it. I will try and do so later to see if the table appears when refreshed on the Mac.

  10. #10
    Registered User
    Join Date
    09-18-2023
    Location
    Frankfurt, Germany
    MS-Off Ver
    Version 16.77
    Posts
    7

    Re: Why is my Excel file so big even though I uploaded the data using Power Pivot/Power Qu

    Thank you! That would be great to know.

  11. #11
    Forum Expert romperstomper's Avatar
    Join Date
    08-13-2008
    Location
    East Sussex, UK
    MS-Off Ver
    365, varying versions/builds
    Posts
    21,297

    Re: Why is my Excel file so big even though I uploaded the data using Power Pivot/Power Qu

    I did a quick test and the data did not get loaded to a table when opening the workbook, or on refresh.

  12. #12
    Registered User
    Join Date
    09-18-2023
    Location
    Frankfurt, Germany
    MS-Off Ver
    Version 16.77
    Posts
    7

    Re: Why is my Excel file so big even though I uploaded the data using Power Pivot/Power Qu

    Thank you for testing it, the problem is solved, thanks!

  13. #13
    Forum Moderator AliGW's Avatar
    Join Date
    08-10-2013
    Location
    Retired in Ipswich, Suffolk, but grew up in Sawley, Derbyshire (England)
    MS-Off Ver
    MS 365 Subscription Insider Beta Channel v. 2406 (Windows 11 23H2 64-bit)
    Posts
    81,587

    Re: Why is my Excel file so big even though I uploaded the data using Power Pivot/Power Qu

    If that takes care of your original question, please choose Thread Tools from the menu link above and mark this thread as SOLVED.

    Also, if you have not already done so, you may not be aware that you can thank anyone who offered you help towards a solution for your issue by clicking the small star icon (* Add Reputation) located in the lower left corner of the post in which the help was given. By doing so you can add to the reputation(s) of each of those who offered help.
    Ali


    Enthusiastic self-taught user of MS Excel who's always learning!
    Don't forget to say "thank you" in your thread to anyone who has offered you help.
    You can reward them by clicking on * Add Reputation below their user name on the left, if you wish.

    Forum Rules (updated August 2023): please read them here.

+ Reply to Thread

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. Replies: 1
    Last Post: 08-03-2023, 09:26 AM
  2. Replies: 2
    Last Post: 12-17-2021, 08:41 AM
  3. [SOLVED] Power Query/Power Pivot Conditional Column creation & chart
    By mz_h in forum Excel Formulas & Functions
    Replies: 7
    Last Post: 12-12-2020, 06:07 PM
  4. [SOLVED] 2 fields checker- Request for alternative option in Power Query or Power Pivot
    By Shareez Saleem in forum Excel Formulas & Functions
    Replies: 5
    Last Post: 11-15-2020, 08:36 AM
  5. Power Query / Power pivot : M2M relationships problem
    By almourasel in forum Excel General
    Replies: 6
    Last Post: 03-26-2020, 05:33 PM
  6. [SOLVED] Power Pivot does not load new column added in Power query
    By ibuhary in forum Excel General
    Replies: 12
    Last Post: 02-19-2019, 03:53 AM
  7. Sub-Forum for Excel Power Tools (Power Query, Power Pivot & Power BI)
    By chullan88 in forum Suggestions for Improvement
    Replies: 10
    Last Post: 06-28-2018, 02:25 PM

Tags for this Thread

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Search Engine Friendly URLs by vBSEO 3.6.0 RC 1