Crawling Google

Started by o239666, January 29, 2013, 06:27:24 AM

o239666

I'm trying to crawl and generate a sitemap of certain google paths eg. www.google.com/blahblah. But when I put in the www.google.com/ in to the root directory box, put in my filters and press search. The search ends quickly because it automatically jumps to www.google.com.au/ because I'm located in Australia. the ".au" interferes with the search. Can I stop this from happening?

Cheers

Bobby.

bedrik

Yes you can do it by some coding but any expert can provide you detail about it.

o239666


Webhelpforums

#3
Are you trying to:

  • create a sitemap of google.com.au content pages?
  • scrape search results?
  • do something else?

It is a bit unusual request for a tool like A1 Sitemap Generator,
so I just want to to make sure I understand your question :)

You may want to email the details:
http://www.microsystools.com/home/contact.php
TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

More About Our Webmaster Tools for Windows and Mac