Webmaster Forums - Website and SEO Help

Microsys Products and Webmaster Tools => A1 Sitemap Generator => Topic started by: priest on August 23, 2013, 08:52:34 PM

Title: Sitemap is too small
Post by: priest on August 23, 2013, 08:52:34 PM
Hello,
when I am done with scaning and trying to make a sitemap it makes much smaller sitemap then it used too.
I had sitemap-index file and 24 parts of 25k urls and now it makes me index file with only 2 parts of the same size as each of the 24 parts before.I thought the scan was incomplete so I did it again but I have the same result. I am totaly confused,could you please help?
thank you
Title: Re: Sitemap is too small
Post by: Webhelpforums on August 24, 2013, 03:33:21 PM
Generally speaking, causes for such "sudden" problems are usually related to:


1)
You marked some pages (tags, categories, similar) for nofollow and noindex in page source (e.g. through a plugin)

See:
http://www.microsystools.com/products/sitemap-generator/help/sitemap-robots-noindex-nofollow/ (http://www.microsystools.com/products/sitemap-generator/help/sitemap-robots-noindex-nofollow/)


2)
You removed some navigational element (or changed it to Javascript) - you can enable some Javascript parsing in "Scan website | Crawler options"


3)
Your website/webserver may have started throwing errors at some point (or just for some pages)

See:
http://www.microsystools.com/products/sitemap-generator/help/server-http-response-codes/ (http://www.microsystools.com/products/sitemap-generator/help/server-http-response-codes/)