+ Reply to Thread
Results 1 to 12 of 12

Excel Big Data alternatives doesn't have formulas

  1. #1
    Registered User
    Join Date
    04-23-2018
    Location
    USA
    MS-Off Ver
    2016
    Posts
    5

    Excel Big Data alternatives doesn't have formulas

    Hey, I have excel sheet with more than 3 million rows. I Tried all these alternative applications to open excel files that are bigger than 1,048,576
    I need to have IF commands and other excel commands in the entire sheet from row 1 to row 3 million
    Here are the applications I used and the problem I had:

    Google Sheets - limited to 200K cells
    Microsoft Excel Live - start to do problems above 500k rows, nearly impossible to scroll down
    MATLAB R2018a (Trial) - doesn't allow excel commands
    Delimit (trial) - doesnt allow excel commands
    Openrefine - doesn't decode the text good
    PowerPivot - look like it a tool that can sum certain columns but can't put if commands in row 2 million

    I also read that people recommending about R and i didn't try it but on youtube it seems like its doesn't compatible with excel commands.


    There is any program that will allow me to use excel commands on sheets with more than 1,048,576 rows?

  2. #2
    Banned User!
    Join Date
    02-05-2015
    Location
    San Escobar
    MS-Off Ver
    any on PC except 365
    Posts
    12,168

    Cool Re: Excel Big Data alternatives doesn't have formulas

    Did you try PowerQuery (Get&Transform) ?

    Power Query for
    or use any database and extract what you want
    Last edited by sandy666; 04-23-2018 at 05:32 PM.

  3. #3
    Registered User
    Join Date
    04-23-2018
    Location
    USA
    MS-Off Ver
    2016
    Posts
    5

    Re: Excel Big Data alternatives doesn't have formulas

    So Power Query doesnt compatible with excel commands?
    I can split the files to 4 file each up to 1 million row but i prefer that it will be on one file.

  4. #4
    Banned User!
    Join Date
    02-05-2015
    Location
    San Escobar
    MS-Off Ver
    any on PC except 365
    Posts
    12,168

    Re: Excel Big Data alternatives doesn't have formulas

    what you mean: excel commands?
    PQ is a build-in into Excel 2016 and 365 so each M language command is an excel command also.
    IMHO if you want to use any excel worksheet FUNCTION(s) on your 3 million rows you'll need to make a coffee for a long time waiting

  5. #5
    Registered User
    Join Date
    04-23-2018
    Location
    USA
    MS-Off Ver
    2016
    Posts
    5

    Re: Excel Big Data alternatives doesn't have formulas

    Quote Originally Posted by sandy666 View Post
    what you mean: excel commands?
    PQ is a build-in into Excel 2016 and 365 so each M language command is an excel command also.
    IMHO if you want to use any excel worksheet FUNCTION(s) on your 3 million rows you'll need to make a coffee for a long time waiting
    PQ allow more than 1,048,576 rows?
    Made this commands on 1 millions rows and it wan't that bad, under 15 seconds but i need a couple of columns so we will see about that.
    MATLAB took me about an hour to install and about a 45 minutes to open the file, and then i can only watch it???
    Also needed to change my windows from 32 Bit to 64 Bit, hopefully it will run fast. All the non Microsoft apps left me with about 3 hairs on my head.

  6. #6
    Banned User!
    Join Date
    02-05-2015
    Location
    San Escobar
    MS-Off Ver
    any on PC except 365
    Posts
    12,168

    Re: Excel Big Data alternatives doesn't have formulas

    PowerQuery limitations
    AFAIK rows loaded to PQ is limited by memory (64 or 32 bits)

    Excel worksheet and PowerQuery table are two different things

    in PQ you can work with whole 3 mln rows and "export" to worksheet only result of your work (1,048,576 rows because of Excel worksheet limitations)
    Last edited by sandy666; 04-23-2018 at 06:20 PM.

  7. #7
    Registered User
    Join Date
    04-23-2018
    Location
    USA
    MS-Off Ver
    2016
    Posts
    5

    Re: Excel Big Data alternatives doesn't have formulas

    It's sounds good, I will try it
    Thanks for your time

  8. #8
    Banned User!
    Join Date
    02-05-2015
    Location
    San Escobar
    MS-Off Ver
    any on PC except 365
    Posts
    12,168

    Re: Excel Big Data alternatives doesn't have formulas

    You are welcome

  9. #9
    Registered User
    Join Date
    04-23-2018
    Location
    USA
    MS-Off Ver
    2016
    Posts
    5

    Re: Excel Big Data alternatives doesn't have formulas

    Is it possible to calculate the average of the 5 cells back?
    The only thing I manage to do is 1+1 and 2*5 for the entire column

    There is any difference between Get&Transform for excel 2016 and PQ for excel 2013?
    I have PQ on excel 2013, if Get&Transform is better I will install excel 2016
    Last edited by spmr156; 04-24-2018 at 10:43 AM.

  10. #10
    Banned User!
    Join Date
    02-05-2015
    Location
    San Escobar
    MS-Off Ver
    any on PC except 365
    Posts
    12,168

    Re: Excel Big Data alternatives doesn't have formulas

    You mean with PQ ?
    PQ works on columns and content not on single cells
    You can use PowerPivot (I mean DataModel) and DAX to calculate what you want
    Last edited by sandy666; 04-24-2018 at 10:49 AM.

  11. #11
    Forum Expert CK76's Avatar
    Join Date
    06-16-2015
    Location
    ONT, Canada
    MS-Off Ver
    MS365 Apps for enterprise
    Posts
    5,885

    Re: Excel Big Data alternatives doesn't have formulas

    You could do it in PQ, but won't be that efficient I'd imagine.

    For calculating average of 5 rows (including current) you'd need to add Index column and something like...
    Please Login or Register  to view this content.
    #"Added Index" should be replaced with what ever is previous step to adding custom column with above calculation.

    0.JPG
    ?Progress isn't made by early risers. It's made by lazy men trying to find easier ways to do something.?
    ― Robert A. Heinlein

  12. #12
    Banned User!
    Join Date
    02-05-2015
    Location
    San Escobar
    MS-Off Ver
    any on PC except 365
    Posts
    12,168

    Re: Excel Big Data alternatives doesn't have formulas

    also you can use pencil and paper
    or PowerBi Desktop (conglomerate of PowerPivot&PowerQuery) but forget about Excel

+ Reply to Thread

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. [SOLVED] Alternatives to slow working formulas
    By Perk1961 in forum Excel Formulas & Functions
    Replies: 4
    Last Post: 02-21-2018, 12:09 AM
  2. [SOLVED] Am I trying to put too much data into a chart - what are alternatives?
    By trstew in forum Excel Charting & Pivots
    Replies: 4
    Last Post: 01-24-2018, 12:20 PM
  3. SharePoint Alternatives for Excel
    By joannakf in forum Excel General
    Replies: 1
    Last Post: 11-01-2016, 02:34 AM
  4. Alternatives to EXCEL?
    By highlystrung in forum Excel General
    Replies: 3
    Last Post: 10-01-2012, 05:25 PM
  5. Faster alternatives to array formulas
    By Spellbound in forum Excel Formulas & Functions
    Replies: 4
    Last Post: 01-10-2012, 08:37 PM
  6. Sumproduct doesn't work with columns... alternatives?
    By qwopzxnm in forum Excel Formulas & Functions
    Replies: 4
    Last Post: 02-17-2006, 06:40 PM
  7. [SOLVED] Alternatives to Excel
    By Spider in forum Excel General
    Replies: 2
    Last Post: 03-01-2005, 09:06 AM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Search Engine Friendly URLs by vBSEO 3.6.0 RC 1