+ Reply to Thread
Results 1 to 3 of 3

powerquery and or pivot to selectively remove 1.5 million rows of data from large list

  1. #1
    Forum Contributor
    Join Date
    12-03-2008
    Location
    Key West, FL
    MS-Off Ver
    365 Apps for Enterprise
    Posts
    665

    powerquery and or pivot to selectively remove 1.5 million rows of data from large list

    I've got a .csv file too large to open in Excel. It has just over 2 million rows. However, if I use Excel's Power Query feature to open the .csv then I can at least see the table in powerquery.

    The table has 3 columns and contains data on just 20 subjects. The first column has the subjects names. So row 1, column 1 would say "Ralph." Each of the next 19 rows has another name. Then the series of names repeat again and again, through 2 million rows.

    I'd like to create a table showing only the rows beginning with the name Ralph. Thus my ideal result would be a table with 3 columns: Ralph, Column2, and Column3 as you see in the attached example workbook.

    Is there a way to filter out the unwanted names in PowerQuery? (or conversely, select only Ralph as a filter?)

    I don't know how to use pivot tables so if the solution involves this I might need some extra help.

    Thanks!
    Attached Files Attached Files

  2. #2
    Forum Moderator alansidman's Avatar
    Join Date
    02-02-2010
    Location
    Steamboat Springs, CO
    MS-Off Ver
    MS Office 365 Version 2405 Win 11 Home 64 Bit
    Posts
    23,882

    Re: powerquery and or pivot to selectively remove 1.5 million rows of data from large list

    In power query, you just need to filter on the name Ralph as shown in the Mcode below.

    Please Login or Register  to view this content.
    Alan עַם יִשְׂרָאֵל חַי


    Change an Ugly Report with Power Query
    Database Normalization
    Complete Guide to Power Query
    Man's Mind Stretched to New Dimensions Never Returns to Its Original Form

  3. #3
    Forum Contributor
    Join Date
    12-03-2008
    Location
    Key West, FL
    MS-Off Ver
    365 Apps for Enterprise
    Posts
    665

    Re: powerquery and or pivot to selectively remove 1.5 million rows of data from large list

    Thanks Alan, I appreciate it!

+ Reply to Thread

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. Remove rows of text using PowerQuery?
    By nobodyukno in forum Excel General
    Replies: 1
    Last Post: 01-13-2017, 11:58 AM
  2. Remove rows of text using PowerQuery?
    By nobodyukno in forum Excel General
    Replies: 2
    Last Post: 01-13-2017, 11:56 AM
  3. Remove rows of text using PowerQuery?
    By nobodyukno in forum Excel General
    Replies: 0
    Last Post: 01-13-2017, 11:41 AM
  4. Replies: 3
    Last Post: 03-24-2016, 01:49 PM
  5. Dealing with 6 million rows of data
    By ccastell88 in forum Excel General
    Replies: 5
    Last Post: 12-18-2014, 01:32 AM
  6. Problem using Autofilter to remove large number of rows of data
    By welchs101 in forum Excel Programming / VBA / Macros
    Replies: 63
    Last Post: 07-30-2013, 07:32 AM
  7. Delete duplicate rows with same data in certain columns for million rows
    By amlan009 in forum Excel Programming / VBA / Macros
    Replies: 9
    Last Post: 02-08-2012, 12:53 AM

Tags for this Thread

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Search Engine Friendly URLs by vBSEO 3.6.0 RC 1