Webmaster Forums - Website and SEO Help

Microsys Products and Webmaster Tools => A1 Sitemap Generator => Topic started by: stano7 on April 06, 2012, 08:50:42 PM

Title: Can't scan site
Post by: stano7 on April 06, 2012, 08:50:42 PM
When I try to scan this wordpress site http://urbancadence.com/, the program looks like it is scanning and flashes something and I hear a ding but then the analyze website tab doesn't have any files or paths listed. I also sellected the wordpress template in the quick scan.  What could be the problem?
Title: Re: Can't scan site
Post by: Webhelpforums on April 06, 2012, 09:30:36 PM
You are using robots noindex + robots nofollow on your website.

Check the source code of http://urbancadence.com:
<meta name='robots' content='noindex,nofollow' />

Naturally, A1 Sitemap Generator defaults to obey such instructions :)

For more information, see the sitemap generator help about robots.txt, canonical, nofollow, noindex etc. (http://www.microsystools.com/products/sitemap-generator/help/sitemap-robots-noindex-nofollow/) (also explains how to make A1SG ignore e.g. nofollow and noindex.

(If you want to make A1SG ignore the nofollow/noindex instructions after reading above help page, make sure to switch off easy mode (http://www.microsystools.com/products/sitemap-generator/help/easy-sitemap-generator-mode/), so you can see all the options.)