+ Reply to Thread
Results 1 to 7 of 7

validating excel data against a mysql db?

  1. #1
    Registered User
    Join Date
    07-22-2005
    Location
    canada
    Posts
    73

    validating excel data against a mysql db?

    Hello,

    I have a constant struggle to validate large amounts of data (specifically phone numbers), against quite a few comparison variables.

    So far I have a "scrub" template. I have approximately 10 worksheets, each with very different reasons for seperation, but all of them consisting of the phone number or valid npanxx (area code-exchange). The issue that I am having is that once I do my initial formatting on the raw data, and then copy and paste my formulas the excel sheet eventually times out (too many comparisons I think, taking too much memory).

    So I was thinking of off-loading the work to a server, or at least reducing the required "in memory" foot print so that the time-outs stop happening.

    I was thinking of loading all the comparison data into a mysql Db (I have one running on a fast access server), and then running an excel macro that compares all the raw data against the comparison data in the Db (usually two specific columns of data, usually 40k rows or more).

    However, I'm not even sure if this is possible?

    Is it possible to :

    1) row by row, compare the value of a specific cell, against multiple tables in
    a mysql database, and if so, "mark" another cell with a specified indicator?

    Would this be more effecient to use a mysql db? or an access Db (which I
    know nothing of how to use.. lol)

    Any help, suggestions, comments, sample code would be greatly apreciated.

    Spyrule.

  2. #2
    Registered User
    Join Date
    07-22-2005
    Location
    canada
    Posts
    73

    bump..

    bump..

    Anybody with any ideas here?

  3. #3
    Registered User
    Join Date
    11-16-2007
    Posts
    5

    access, excel vs mysql

    how many rows and columns do you have in your database?
    Last edited by excelsolution; 11-16-2007 at 04:42 PM.

  4. #4
    Registered User
    Join Date
    07-22-2005
    Location
    canada
    Posts
    73
    I currently have 10 worksheets, each with several columns, although I only use one column as the comparison, and each worksheet, has anywhere up to a full 65535 rows of data.
    one, actually has 3 columns for a total reference of 140k+ comparisons.

    so, approximately... 1/2 to 3/4 of a million rows of data. Now the data is seperated into 2 types of data.

    full phone numbers, and npa-nxx (areacode-exchange).

    I would build something like this in access, but honestly... I know NOTHING about access (except that its a relational Db).

  5. #5
    Registered User
    Join Date
    11-16-2007
    Posts
    5

    access, excel vs mysql

    Ok.
    I suggest you to use Ms.Access for this. If yo want to use mysql and other database programs (mysql,sql,firebird,db2..) you must use database server. But access dont need extra server.
    And I have an access file which have more than 15 columns and about 1.600.000 rows.

    if you need help about Access, I can try help you

  6. #6
    Registered User
    Join Date
    07-22-2005
    Location
    canada
    Posts
    73

    I actually have a mysql server.

    Hello,

    I actually have a mysql server (it's part of a full server package), and I have full access to the server (I am the admin).

    The problem with Access for me, is that I have literally NO experience with it, and I would like to get this tool working sooner then later, and if I did it in access, it would take me weeks just to get to a point where I could START to do what I need to do.

  7. #7
    Registered User
    Join Date
    11-16-2007
    Posts
    5

    Access

    ok. I again suggest to use Ms.Access.

+ Reply to Thread

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Search Engine Friendly URLs by vBSEO 3.6.0 RC 1