+ Reply to Thread
Results 1 to 5 of 5

Ram or Processor - Power Query

  1. #1
    Forum Contributor
    Join Date
    01-20-2015
    Location
    NB, Canada
    MS-Off Ver
    365
    Posts
    164

    Ram or Processor - Power Query

    When power query is calculating data is that powered by RAM or the CPU ?

    Thanks
    Attached Images Attached Images

  2. #2
    Administrator 6StringJazzer's Avatar
    Join Date
    01-27-2010
    Location
    Tysons Corner, VA, USA
    MS-Off Ver
    MS365 Family 64-bit
    Posts
    24,721

    Re: Ram or Processor - Power Query

    Computing is not a matter of CPU or RAM. That's like asking whether a truck carries a load using the motor or the trailer. You need both. The calculations are performed by the CPU. RAM is used to hold data. The more interesting question is which one is the limiting factor for any particular application. For example, Google Chrome uses a lot of RAM but not much CPU. What Power Query uses depends entirely on what you are doing with it, but is it very likely CPU-intensive.

    We can give you better information if you can explain what you are trying to get at with your question.
    Jeff
    | | |會 |會 |會 |會 | |:| | |會 |會
    Read the rules
    Use code tags to [code]enclose your code![/code]

  3. #3
    Forum Contributor
    Join Date
    01-20-2015
    Location
    NB, Canada
    MS-Off Ver
    365
    Posts
    164

    Re: Ram or Processor - Power Query

    Yes, you are correct.

    I have two processes I do commonly. I wonder if I can increase the speed at which these tasks complete.
    Here are some specs for my desktop: 32 GB DDR4 ram and a i9 10900KF processor.

    The first process relates to power query.
    I use power query to combine and analyze either, large csv files or many json files.

    The second process relates to a VBA I had written for me that scrapes json's from an API.
    The cookie needed to scrape the API is only good for one hour, and the amount of data can exceed that.

    I am going to upgrade from 32 GB ram to 96 GB. Any other ideas how to speed up either process? (without re-writing the VBA code)
    Attached Images Attached Images

  4. #4
    Administrator 6StringJazzer's Avatar
    Join Date
    01-27-2010
    Location
    Tysons Corner, VA, USA
    MS-Off Ver
    MS365 Family 64-bit
    Posts
    24,721

    Re: Ram or Processor - Power Query

    You should monitor system performance using Task Manager, or something more sophisticated, to see where the limit is. You are using some pretty heavy-duty hardware there.

    I'm a little unclear on your description. Are you saying that you have a task that takes longer than an hour?

  5. #5
    Forum Contributor
    Join Date
    01-20-2015
    Location
    NB, Canada
    MS-Off Ver
    365
    Posts
    164

    Re: Ram or Processor - Power Query

    Yes, potentially longer than an hour, to download all the json files from the API.

    I've attached two pictures

    The pic with 2% CPU usage is when I'm downloading the json files from the API via a VBA in excel.

    The pic with 53% CPU usage is when I'm using power query to combine jsons and export to the data to an excel worksheet.


    Doesn't look like I'm bottlenecking with the RAM or CPU.
    Attached Images Attached Images

+ Reply to Thread

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. Power Query - Feeding dynamic sheet name to Power query
    By egoosen3 in forum Excel General
    Replies: 5
    Last Post: 09-13-2023, 07:41 AM
  2. [SOLVED] 2 fields checker- Request for alternative option in Power Query or Power Pivot
    By Shareez Saleem in forum Excel Formulas & Functions
    Replies: 5
    Last Post: 11-15-2020, 08:36 AM
  3. Replies: 10
    Last Post: 06-25-2020, 12:19 AM
  4. [SOLVED] Power Query - excel formula translation into Power Query
    By afgi in forum Excel Charting & Pivots
    Replies: 7
    Last Post: 02-19-2020, 03:38 AM
  5. Replies: 4
    Last Post: 02-17-2020, 06:03 AM
  6. Excel Power Query Refresh or Access Query - 2nd Query Run is faster
    By Steveapa in forum Excel Programming / VBA / Macros
    Replies: 3
    Last Post: 01-03-2020, 10:16 AM
  7. Sub-Forum for Excel Power Tools (Power Query, Power Pivot & Power BI)
    By chullan88 in forum Suggestions for Improvement
    Replies: 10
    Last Post: 06-28-2018, 02:25 PM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Search Engine Friendly URLs by vBSEO 3.6.0 RC 1