Webmaster Forums - Website and SEO Help

Microsys Products and Webmaster Tools => A1 Sitemap Generator => Topic started by: ronthai on March 02, 2014, 09:46:51 AM

Title: ONLY index is scanned
Post by: ronthai on March 02, 2014, 09:46:51 AM
Hi,

2 of my sites will not scan. They will NOT go any further then the main index page (=domain name).

This index.html is an introduction page that then leads with a link to a WordPress setup, but the scan never gets there. When it is finished within 20 seconds, only the index shows in the sitemap.

1 site (domain name) is brand new, well 2+ months old and even Google only has the first index page and nothing more, when search for "site:domain.com"

I have no robots/txt or anything in the domains.

Any idea's here??

I have no problems with any of my other websites.
Title: Re: ONLY index is scanned
Post by: Webhelpforums on March 03, 2014, 04:16:02 PM
Have you checked if your pages are marked noindex? (Possibly if HTTP headers with noindex are sent) That is the most common explanation for what you are experiencing.

Otherwise, please write your website URLs that are causing you problems or email them:
http://www.microsystools.com/home/contact.php (http://www.microsystools.com/home/contact.php)
Title: Re: ONLY index is scanned
Post by: ronthai on March 03, 2014, 09:44:03 PM
Thanks,

Don't I feel stupid now :o

Setting in WP was ON (Discourage search engines from indexing this site)

Ron