Crawling Google

  • 3 Replies
  • 1250 Views
*

o239666

  • Newbie
  • *
  • 4
  • +0/-0
    • View Profile
Crawling Google
« on: January 29, 2013, 06:27:24 AM »
I'm trying to crawl and generate a sitemap of certain google paths eg. www.google.com/blahblah. But when I put in the www.google.com/ in to the root directory box, put in my filters and press search. The search ends quickly because it automatically jumps to www.google.com.au/ because I'm located in Australia. the ".au" interferes with the search. Can I stop this from happening?

Cheers

Bobby.

*

bedrik

  • Full Member
  • ***
  • 161
  • +0/-0
    • View Profile
Re: Crawling Google
« Reply #1 on: January 29, 2013, 06:38:47 AM »
Yes you can do it by some coding but any expert can provide you detail about it.

*

o239666

  • Newbie
  • *
  • 4
  • +0/-0
    • View Profile
Re: Crawling Google
« Reply #2 on: January 29, 2013, 06:44:43 AM »
Any experts out there?  :D

*

Webhelpforums

  • Administrator
  • Hero Member
  • *****
  • 1386
  • +6/-0
  • Shared between Microsys, WebHelpForums and helpers
    • View Profile
    • Webmaster and Website Help Forums
Re: Crawling Google
« Reply #3 on: January 29, 2013, 01:36:17 PM »
Are you trying to:
  • create a sitemap of google.com.au content pages?
  • scrape search results?
  • do something else?

It is a bit unusual request for a tool like A1 Sitemap Generator,
so I just want to to make sure I understand your question :)

You may want to email the details:
http://www.microsystools.com/home/contact.php
« Last Edit: January 29, 2013, 01:39:30 PM by Webhelpforums »
MicrosysTools.com | Website and SEO Software for webmasters | A1 Sitemap Generator, A1 Website Analyzer etc.

 




See Our Webmaster Tools for Windows and Mac

A1 Sitemap Generator
      
A1 Website Analyzer
      
A1 Keyword Research
      
A1 Website Download
      
A1 Website Search Engine
      
A1 Website Scraper