ONLY index is scanned

Started by ronthai, March 02, 2014, 09:46:51 AM

ronthai

Hi,

2 of my sites will not scan. They will NOT go any further then the main index page (=domain name).

This index.html is an introduction page that then leads with a link to a WordPress setup, but the scan never gets there. When it is finished within 20 seconds, only the index shows in the sitemap.

1 site (domain name) is brand new, well 2+ months old and even Google only has the first index page and nothing more, when search for "site:domain.com"

I have no robots/txt or anything in the domains.

Any idea's here??

I have no problems with any of my other websites.

Webhelpforums

#1
Have you checked if your pages are marked noindex? (Possibly if HTTP headers with noindex are sent) That is the most common explanation for what you are experiencing.

Otherwise, please write your website URLs that are causing you problems or email them:
http://www.microsystools.com/home/contact.php
TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

ronthai

Thanks,

Don't I feel stupid now :o

Setting in WP was ON (Discourage search engines from indexing this site)

Ron

More About Our Webmaster Tools for Windows and Mac

HTML, image, video and hreflang XML sitemap generatorA1 Sitemap Generator
      
website analysis spider tool for technical SEOA1 Website Analyzer
      
SEO tools for managing keywords and keyword listsA1 Keyword Research
      
complete website copier toolA1 Website Download
      
create custom website search enginesA1 Website Search Engine
      
scrape data into CSV, SQL and databasesA1 Website Scraper