Webmaster Forums - Website and SEO Help

Microsys Products and Webmaster Tools => A1 Website Download => Topic started by: Hajik on February 04, 2012, 06:50:13 PM

Title: Download economic calendar
Post by: Hajik on February 04, 2012, 06:50:13 PM
Hi,
I'm doing a research on impacts of economic news on market prices and I need to download http://www.example.com.com/ economic calendar from 1 Jan 2007 till today.-5 Feb 2012-
Link:
http://www.example.com.com/calendar.php
-------------------
Does A1 Website Download have the capability to download such rich environment ?
I 'm not very well informed in computer stuff. If the answer is positive please share the proper and optimum *.ini file.

Thanks in advance,

Best Regards,
Hajik.
Title: Re: Download Forexfactory.com economic calendar
Post by: Webhelpforums on February 05, 2012, 09:15:49 AM
I don't think it will be a problem, but drop an email to support http://www.microsystools.com/home/contact.php (http://www.microsystools.com/home/contact.php) and there will hopefully be a project file sent your way :)

Meanwhile, look into

* analysis filters
http://www.microsystools.com/products/website-download/help/website-crawler-scanner-filters/ (http://www.microsystools.com/products/website-download/help/website-crawler-scanner-filters/)

* output filters
http://www.microsystools.com/products/website-download/help/website-crawler-output-filters/ (http://www.microsystools.com/products/website-download/help/website-crawler-output-filters/)
Title: Re: Download Forexfactory.com economic calendar
Post by: Webhelpforums on February 05, 2012, 08:25:34 PM
Actually, just_

1)
Add ":calendar.php" (without "") to the "limit-to" list in "analysis filters"

2)
Add e.g. the URL of the first calendar entry to "start search paths":
http://www.microsystools.com/products/website-download/help/root-aliases-start-paths/ (http://www.microsystools.com/products/website-download/help/root-aliases-start-paths/)

That's all required really :)

...

Do notice that will analyze all the pages you want, but the download itself will also include all URLs references from those pages you limited analysis to (i.e. images etc.)

...

If you want to scrape specific parts of data of URLs in a website (and not download and store the actual website pages) take a look at A1 Website Scraper (but does require you know regular expressions for scraping off the bits of data you need/want)