Crawling Google

Started by o239666, January 29, 2013, 06:27:24 AM


I'm trying to crawl and generate a sitemap of certain google paths eg. But when I put in the in to the root directory box, put in my filters and press search. The search ends quickly because it automatically jumps to because I'm located in Australia. the ".au" interferes with the search. Can I stop this from happening?




Yes you can do it by some coding but any expert can provide you detail about it.



Are you trying to:

  • create a sitemap of content pages?
  • scrape search results?
  • do something else?

It is a bit unusual request for a tool like A1 Sitemap Generator,
so I just want to to make sure I understand your question :)

You may want to email the details:
TechSEO360 |  | A1 Sitemap Generator, A1 Website Analyzer etc.

More About Our Webmaster Tools for Windows and Mac