Crawling Google

Started by o239666, January 29, 2013, 06:27:24 AM

o239666

I'm trying to crawl and generate a sitemap of certain google paths eg. www.google.com/blahblah. But when I put in the www.google.com/ in to the root directory box, put in my filters and press search. The search ends quickly because it automatically jumps to www.google.com.au/ because I'm located in Australia. the ".au" interferes with the search. Can I stop this from happening?

Cheers

Bobby.

bedrik

Yes you can do it by some coding but any expert can provide you detail about it.

o239666


Webhelpforums

#3
Are you trying to:

  • create a sitemap of google.com.au content pages?
  • scrape search results?
  • do something else?

It is a bit unusual request for a tool like A1 Sitemap Generator,
so I just want to to make sure I understand your question :)

You may want to email the details:
http://www.microsystools.com/home/contact.php
TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

More About Our Webmaster Tools for Windows and Mac

HTML, image, video and hreflang XML sitemap generatorA1 Sitemap Generator
      
website analysis spider tool for technical SEOA1 Website Analyzer
      
SEO tools for managing keywords and keyword listsA1 Keyword Research
      
complete website copier toolA1 Website Download
      
create custom website search enginesA1 Website Search Engine
      
scrape data into CSV, SQL and databasesA1 Website Scraper