+ Reply to Thread
Results 1 to 2 of 2

Moving data from A to B - How to optimize for large data sets

  1. #1
    Registered User
    Join Date
    10-29-2018
    Location
    Konstanz, Germany
    MS-Off Ver
    2016, 64 Bit
    Posts
    1

    Moving data from A to B - How to optimize for large data sets

    Hello everyone

    My question concerns the probably most fundamental thing on Excel: Moving data from one place to another.

    I have several tables with about 20,000 rows of data. I am using a Database-ID (“DB_ID”) which is common in all tables. I then loop through table A, read out the DB_ID, search it in table B to find the corresponding source row and then transfer the data I need.

    For this purpose I have first used the “Application.Match” command.

    Later I switched to defining a search range and using the “.find” command, which allowed me to deal with cases the DB_ID is not found. Following is an example of the latter approach:

    Please Login or Register  to view this content.
    Now, while this does work as intended, it is getting quite slow. Some operations take several minutes by now, which really adds up.

    Do you please have any suggestions how I can improve my code.

    Kind regards

    GodOfGrain

  2. #2
    Forum Expert Olly's Avatar
    Join Date
    09-10-2013
    Location
    Darlington, UK
    MS-Off Ver
    Excel 2016, 2019, 365
    Posts
    6,284

    Re: Moving data from A to B - How to optimize for large data sets

    Use Power Query instead.
    let Source = #table({"Question","Thread", "User"},{{"Answered","Mark Solved", "Add Reputation"}}) in Source

    If I give you Power Query (Get & Transform Data) code, and you don't know what to do with it, then CLICK HERE

    Walking the tightrope between genius and eejit...

+ Reply to Thread

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. How to optimize Index Match , for large sets of data
    By asweare in forum Excel Programming / VBA / Macros
    Replies: 18
    Last Post: 12-29-2018, 12:46 PM
  2. Replies: 5
    Last Post: 06-05-2016, 11:32 AM
  3. [ASK] How to Optimize function in Google Sheet for large data
    By qiyusi in forum For Other Platforms(Mac, Google Docs, Mobile OS etc)
    Replies: 0
    Last Post: 10-31-2014, 06:06 AM
  4. Compare & Fill Data - Large Data Sets - Question
    By mitko007 in forum Excel Programming / VBA / Macros
    Replies: 12
    Last Post: 07-26-2013, 01:52 AM
  5. [SOLVED] Data Thinner code seems very inefficient- used on large data sets
    By Canuckle777 in forum Excel Programming / VBA / Macros
    Replies: 4
    Last Post: 07-25-2013, 10:29 AM
  6. data problems, matching large data sets with smaller known points
    By awguest1 in forum Excel Formulas & Functions
    Replies: 4
    Last Post: 05-28-2013, 08:48 PM
  7. Replies: 1
    Last Post: 04-02-2011, 06:39 AM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Search Engine Friendly URLs by vBSEO 3.6.0 RC 1