+ Reply to Thread
Results 1 to 15 of 15

Data Formatting Question for Data scraped from the Internet

  1. #1
    Registered User
    Join Date
    06-01-2023
    Location
    Los Angeles, California
    MS-Off Ver
    2020
    Posts
    6

    Data Formatting Question for Data scraped from the Internet

    Hi all!

    I am using a data scraper to pull info from the web and an struggling to transform it in a way that's easily read.

    Right now the csv file comes out like this:

    Title1 - data1
    Title2 - data2
    Title3 - data3
    Title1 - data4
    Title2 - data5
    Title3 - data6

    And then it repeats like that. What I want is to move the titles into the columns and then have the right side with all the data moved into the corresponding columns with the appropriate titles like

    Title1 title2 title3
    Data1 data2 data3
    Data4 data5 data6

    If anyone could give me some tips on how to transform the data I would appreciate it! I mostly just don't really know how to aggregate all the titles and get the relevant data into the corresponding column.

    Thank you!
    Attached Files Attached Files

  2. #2
    Banned User!
    Join Date
    02-05-2015
    Location
    San Escobar
    MS-Off Ver
    any on PC except 365
    Posts
    12,168

    Cool Re: Data Formatting Question for Data scraped from the Internet

    something like this?
    Attached Files Attached Files

  3. #3
    Registered User
    Join Date
    06-01-2023
    Location
    Los Angeles, California
    MS-Off Ver
    2020
    Posts
    6

    Re: Data Formatting Question for Data scraped from the Internet

    Kinda like that but having each entry be under a single "Word Mark" column and so on and so forth - so it looks more like a table where each trademarks information is lined up in the same row.

  4. #4
    Banned User!
    Join Date
    02-05-2015
    Location
    San Escobar
    MS-Off Ver
    any on PC except 365
    Posts
    12,168

    Re: Data Formatting Question for Data scraped from the Internet

    post an example with real expected result (from your source data)

  5. #5
    Banned User!
    Join Date
    02-05-2015
    Location
    San Escobar
    MS-Off Ver
    any on PC except 365
    Posts
    12,168

    Cool Re: Data Formatting Question for Data scraped from the Internet

    maybe like this
    Attached Files Attached Files
    Last edited by sandy666; 06-01-2023 at 07:28 PM.

  6. #6
    Registered User
    Join Date
    06-01-2023
    Location
    Los Angeles, California
    MS-Off Ver
    2020
    Posts
    6

    Re: Data Formatting Question for Data scraped from the Internet

    This is perfect! Thank you so much! How did you do this?

  7. #7
    Banned User!
    Join Date
    02-05-2015
    Location
    San Escobar
    MS-Off Ver
    any on PC except 365
    Posts
    12,168

    Re: Data Formatting Question for Data scraped from the Internet

    with Power Query




    if the problem is solved, make me happy and hit Add Reputation (bottom left corner next to the post that was helpful)
    and then mark the thread as SOLVED (top above your first post - Thread Tools)

  8. #8
    Registered User
    Join Date
    06-01-2023
    Location
    Los Angeles, California
    MS-Off Ver
    2020
    Posts
    6

    Re: Data Formatting Question for Data scraped from the Internet

    Got it. I will see if I can mess around with power query to try to get something similar to what you did.

  9. #9
    Banned User!
    Join Date
    02-05-2015
    Location
    San Escobar
    MS-Off Ver
    any on PC except 365
    Posts
    12,168

    Re: Data Formatting Question for Data scraped from the Internet

    sure, here's some help if you need it : Power Query documentation

  10. #10
    Registered User
    Join Date
    06-01-2023
    Location
    Los Angeles, California
    MS-Off Ver
    2020
    Posts
    6

    Re: Data Formatting Question for Data scraped from the Internet

    Hello! I know its been awhile but I was wondering if you could tell me why the power query you wrote only goes up to 195 records. I wasn't sure if I could write a loop for the split function which would make it go beyond 195 records or if I would have to manually type out a list like that for any of my documents with more than 195. I have a couple with 600+ and one with over 2700 records so it would be really helpful to figure out how to do it without manually typing in each one. THank you!

    for reference, this is the function I am referring to:

    = Table.SplitColumn(rc1, "list", Splitter.SplitTextByDelimiter("=", QuoteStyle.Csv), {"list.1", "list.2", "list.3", "list.4", "list.5", "list.6", "list.7", "list.8", "list.9", "list.10", "list.11", "list.12", "list.13", "list.14", "list.15", "list.16", "list.17", "list.18", "list.19", "list.20", "list.21", "list.22", "list.23", "list.24", "list.25", "list.26", "list.27", "list.28", "list.29", "list.30", "list.31", "list.32", "list.33", "list.34", "list.35", "list.36", "list.37", "list.38", "list.39", "list.40", "list.41", "list.42", "list.43", "list.44", "list.45", "list.46", "list.47", "list.48", "list.49", "list.50", "list.51", "list.52", "list.53", "list.54", "list.55", "list.56", "list.57", "list.58", "list.59", "list.60", "list.61", "list.62", "list.63", "list.64", "list.65", "list.66", "list.67", "list.68", "list.69", "list.70", "list.71", "list.72", "list.73", "list.74", "list.75", "list.76", "list.77", "list.78", "list.79", "list.80", "list.81", "list.82", "list.83", "list.84", "list.85", "list.86", "list.87", "list.88", "list.89", "list.90", "list.91", "list.92", "list.93", "list.94", "list.95", "list.96", "list.97", "list.98", "list.99", "list.100", "list.101", "list.102", "list.103", "list.104", "list.105", "list.106", "list.107", "list.108", "list.109", "list.110", "list.111", "list.112", "list.113", "list.114", "list.115", "list.116", "list.117", "list.118", "list.119", "list.120", "list.121", "list.122", "list.123", "list.124", "list.125", "list.126", "list.127", "list.128", "list.129", "list.130", "list.131", "list.132", "list.133", "list.134", "list.135", "list.136", "list.137", "list.138", "list.139", "list.140", "list.141", "list.142", "list.143", "list.144", "list.145", "list.146", "list.147", "list.148", "list.149", "list.150", "list.151", "list.152", "list.153", "list.154", "list.155", "list.156", "list.157", "list.158", "list.159", "list.160", "list.161", "list.162", "list.163", "list.164", "list.165", "list.166", "list.167", "list.168", "list.169", "list.170", "list.171", "list.172", "list.173", "list.174", "list.175", "list.176", "list.177", "list.178", "list.179", "list.180", "list.181", "list.182", "list.183", "list.184", "list.185", "list.186", "list.187", "list.188", "list.189", "list.190", "list.191", "list.192", "list.193", "list.194", "list.195"})

  11. #11
    Banned User!
    Join Date
    02-05-2015
    Location
    San Escobar
    MS-Off Ver
    any on PC except 365
    Posts
    12,168

    Re: Data Formatting Question for Data scraped from the Internet

    maybe it will help How to iterate web result

  12. #12
    Registered User
    Join Date
    06-01-2023
    Location
    Los Angeles, California
    MS-Off Ver
    2020
    Posts
    6

    Re: Data Formatting Question for Data scraped from the Internet

    This has some useful information, thank you! I am trying to incorporate the list.Max function the guy in the video uses but haven't had any luck so far. I will continue trying.

  13. #13
    Banned User!
    Join Date
    02-05-2015
    Location
    San Escobar
    MS-Off Ver
    any on PC except 365
    Posts
    12,168

    Re: Data Formatting Question for Data scraped from the Internet

    this is a procedure in Power Query and you added limited csv so in the result you got 195 records only
    use bigger csv and try split expanded list by defined delimiter, you don't need write all these values you show manually
    for your information Power Query is not a vba
    Last edited by sandy666; 06-29-2023 at 01:49 AM.

  14. #14
    Banned User!
    Join Date
    02-05-2015
    Location
    San Escobar
    MS-Off Ver
    any on PC except 365
    Posts
    12,168

    Cool Re: Data Formatting Question for Data scraped from the Internet

    you can try this modified Power Query for other csvs
    Attached Files Attached Files

  15. #15
    Valued Forum Contributor
    Join Date
    06-23-2021
    Location
    Romania
    MS-Off Ver
    2021, 365 v 2208
    Posts
    722

    Re: Data Formatting Question for Data scraped from the Internet

    Hi,
    I don't know if you have a FILTER function in your Mac Excel version but if you have,
    transform the range of data i columns A:B in table,
    in the new sheet copy the titles and paste special transpose the data.
    In A2 in the new sheet insert a formula:
    Formula: copy to clipboard
    Please Login or Register  to view this content.

    and drag it to right
    Attached Files Attached Files
    Diana Tanase


    If the solutions offered helped you to solve your problem, then mark the thread as SOLVED (thread tools in the top menu) and you can click on * to add reputation to those who helped you, as a way to say thank you !

+ Reply to Thread

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. [SOLVED] Data Extraction / Formatting question
    By Doofus1 in forum Excel Formulas & Functions
    Replies: 6
    Last Post: 03-02-2022, 01:35 PM
  2. Turn Scraped Data into a readable list
    By h_ven in forum Excel Formulas & Functions
    Replies: 0
    Last Post: 07-31-2020, 12:41 PM
  3. Data Validation with a Indirect Lookup Formatting Question
    By playmartit in forum Excel General
    Replies: 3
    Last Post: 06-22-2016, 12:28 PM
  4. How to Organize Scraped Data
    By anartey in forum Excel Programming / VBA / Macros
    Replies: 13
    Last Post: 12-20-2015, 02:13 AM
  5. Cleaning up Data Scraped From the Web by Deleting Certain Rows
    By torchD. in forum Excel Programming / VBA / Macros
    Replies: 1
    Last Post: 02-20-2015, 10:52 AM
  6. Excel Data Import Formatting Question
    By NewtonDKC in forum Excel Formulas & Functions
    Replies: 1
    Last Post: 10-01-2013, 01:15 PM
  7. Data Formatting Question
    By Chris Newby in forum Excel General
    Replies: 8
    Last Post: 10-17-2005, 01:05 PM

Tags for this Thread

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Search Engine Friendly URLs by vBSEO 3.6.0 RC 1