Webmaster Forums - Website and SEO Help

Microsys Products and Webmaster Tools => A1 Website Scraper => Topic started by: petermustermann on September 11, 2013, 10:18:37 AM

Title: my first project and I fail
Post by: petermustermann on September 11, 2013, 10:18:37 AM
Hi everybody,
I just found the program and think its a great tool, but unfortunately even after I viewed the tutorial video I don't understand what to do.
I want to get my dota2 stats from here http://dotabuff.com/players/16818057/matches to a csv file.
The program also founds the 42 additional pages and under extern links the links for more details of each match. (i.e. http://dotabuff.com/matches/301907640) But now I don't kow what to do. I want a csv thats include the following columns:
- Hero (name no the picture)
- Result (only win or loss not when it happen=
- Match ID (the number)
- Format (thats currently under Match ID aswell i.e. captains mode)
- Duration   
- KDA (each in one cell)
- Items (the names not the pictures)

and if the program can do this additional from the match page per column
- Level
- Gold
- LH
- DN
- XPM
- GPM

If anybody could explain me how this has to been done, I'll promise I'll buy the program asap.

Thank you for your help in advance.
Title: Re: my first project and I fail
Post by: Webhelpforums on September 13, 2013, 06:04:45 AM
Have you also read:
http://www.microsystools.com/products/website-scraper/help/scrape-websites-tutorial/ (http://www.microsystools.com/products/website-scraper/help/scrape-websites-tutorial/)

The software also comes with 4 different examples each showing these things:
* Input data (i.e. this would usually be the HTML of the pages you wish to scape)
* How to define columns in output CSV
* Regular expression to extract from input data into columns
* How the output data looks like

...

From your example, you could probably benefit from setting root to
http://dotabuff.com

then limit analysis + output to
/players/16818057/

then limit output to
/matches

and add start search path
http://dotabuff.com/players/16818057/

...

Anyhow, I suggest you first make sure how extraction works by viewing the examples.

(If you want a program where you can visually markup data you want extract, it should be said that A1 Website Scraper does not support that - just in case that is what you are looking for)