+ Reply to Thread
Results 1 to 6 of 6

Power Query column word occurrence calculation performance

  1. #1
    Forum Contributor
    Join Date
    04-30-2010
    Location
    Denmark
    MS-Off Ver
    Office 365
    Posts
    215

    Power Query column word occurrence calculation performance

    Hi all

    Im struggling a bit with Power Query performance.

    In this case, I have a column with close to 7.000 rows. There are some duplicates in the column. Via index I have made a new column with relation (ie duplicates in relation with value 1 and 2), and another with occurrence (ie duplicates value 2):
    Occurrence.png

    The Occurrence steps are done through a merge with the table itself, and then a RowCount, which might be a bit excessive, but I could not find a better way to do it.

    Please Login or Register  to view this content.
    This works and does give the right results, but it takes more than 5 minutes to do the Occurrence calculation.

    So im looking for a way to improve the performance of this, so it does not take minutes and would greatly appreciate any help.

    Thanks in advance

    Best regards
    Imbizile

    PS. I know this can be done faster via VBA and formulas, but I need to do it in Power Query.
    Attached Files Attached Files

  2. #2
    Forum Moderator alansidman's Avatar
    Join Date
    02-02-2010
    Location
    Steamboat Springs, CO
    MS-Off Ver
    MS Office 365 Version 2405 Win 11 Home 64 Bit
    Posts
    23,933

    Re: Power Query column word occurrence calculation performance

    Would this presentation work for you? It is almost immediate in time to calculate

    Please Login or Register  to view this content.
    Attached Files Attached Files
    Alan עַם יִשְׂרָאֵל חַי


    Change an Ugly Report with Power Query
    Database Normalization
    Complete Guide to Power Query
    Man's Mind Stretched to New Dimensions Never Returns to Its Original Form

  3. #3
    Forum Contributor
    Join Date
    04-30-2010
    Location
    Denmark
    MS-Off Ver
    Office 365
    Posts
    215

    Re: Power Query column word occurrence calculation performance

    Hmn, its seems to be missing the Occurrence column, which is the one im having performance issues with - or am I missing something in your solution?

  4. #4
    Forum Guru Bo_Ry's Avatar
    Join Date
    09-10-2018
    Location
    Thailand
    MS-Off Ver
    MS 365
    Posts
    7,213

    Re: Power Query column word occurrence calculation performance

    Please try

    Please Login or Register  to view this content.
    AddedIndex step can be deleted if not need.

  5. #5
    Forum Moderator alansidman's Avatar
    Join Date
    02-02-2010
    Location
    Steamboat Springs, CO
    MS-Off Ver
    MS Office 365 Version 2405 Win 11 Home 64 Bit
    Posts
    23,933

    Re: Power Query column word occurrence calculation performance

    The items list the first and then second occurrence instead of showing each with multiple occurrences. Just a thought on presentation. If there were more it would list them as 1, 2, 3, etc.

  6. #6
    Forum Contributor
    Join Date
    04-30-2010
    Location
    Denmark
    MS-Off Ver
    Office 365
    Posts
    215

    Re: Power Query column word occurrence calculation performance

    Thanks both of you!

    @Bo_Ry, That works like a charm - thanks so much!

    @alansidman, That was the relation column, I already had - I needed the presentation of occurrences.

    I will close this thread.

+ Reply to Thread

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. Replies: 10
    Last Post: 06-25-2020, 12:19 AM
  2. [SOLVED] Power Query Custom Column to identify First Occurrence of Data
    By ibuhary in forum Excel General
    Replies: 18
    Last Post: 12-16-2019, 11:46 AM
  3. Custom Permutations Column in Power Query from two columns in the same Query
    By PaintPaddy in forum Excel Programming / VBA / Macros
    Replies: 1
    Last Post: 07-11-2019, 02:48 PM
  4. [SOLVED] Power Pivot does not load new column added in Power query
    By ibuhary in forum Excel General
    Replies: 12
    Last Post: 02-19-2019, 03:53 AM
  5. Sub-Forum for Excel Power Tools (Power Query, Power Pivot & Power BI)
    By chullan88 in forum Suggestions for Improvement
    Replies: 10
    Last Post: 06-28-2018, 02:25 PM
  6. Power query - replace all contents if word appears
    By rewdsaDSAdas in forum Excel Programming / VBA / Macros
    Replies: 4
    Last Post: 04-08-2017, 04:27 PM
  7. [SOLVED] Power Query: Identify 1st Occurrence of Value
    By kimbekaw in forum Excel Programming / VBA / Macros
    Replies: 4
    Last Post: 07-13-2016, 03:24 PM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Search Engine Friendly URLs by vBSEO 3.6.0 RC 1