Incomplete scan

  • 3 Replies
  • 2082 Views
*

thallstd

  • Newbie
  • *
  • 7
  • +0/-0
    • View Profile
Incomplete scan
« on: September 15, 2012, 07:11:45 PM »
I have a site with over 850 html pages on it but A1 is generating a sitemap with only 36 html files.  The pages are not all linked from index.html and exist in various directories and subdirectories.  However I have another site structured the same way and it scans fine.  I have checked the A1 settings between the two and can't find any differences.  I have checked the .htaccess and 404 error handling on both sites and both are using the same scheme.

Any idea what else I should look at?

Thanks,
Ty

*

Webhelpforums

  • Administrator
  • Hero Member
  • *****
  • 1414
  • +6/-0
  • Shared between Microsys, WebHelpForums and helpers
    • View Profile
    • Webmaster and Website Help Forums
Re: Incomplete scan
« Reply #1 on: September 16, 2012, 08:55:57 AM »
You should probably contact/email your project file + examples of missing URLs:
http://www.microsystools.com/home/contact.php


That said, you can try the following things:

1)
Switch off "easy mode"
http://www.microsystools.com/products/sitemap-generator/help/easy-sitemap-generator-mode/

2)
Check/enable:
Scan website | Crawler options:
* Always scan directories that conttain linked URLs
* Try search for links in Javascript

3)
Add more "start search paths" to project:
http://www.microsystools.com/products/sitemap-generator/help/root-aliases-start-paths/
TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

*

Joyce

  • Newbie
  • *
  • 1
  • +0/-0
    • View Profile
Re: Incomplete scan
« Reply #2 on: October 19, 2012, 10:13:06 AM »
I am having a similar problem.  The software returns no urls at all.  only the root domain.

*

Webhelpforums

  • Administrator
  • Hero Member
  • *****
  • 1414
  • +6/-0
  • Shared between Microsys, WebHelpForums and helpers
    • View Profile
    • Webmaster and Website Help Forums
Re: Incomplete scan
« Reply #3 on: October 19, 2012, 11:21:56 AM »
Hi Joyce,

Sounds like you have a slightly different kind of problem.

Whenever I encounter "returns no URLs at all" it is almost always caused by webmaster using either noindex, nofollow or robots.txt exclusion in their website (which A1 Sitemap Generator defaults to obey)

Please see:
http://www.microsystools.com/products/sitemap-generator/help/sitemap-robots-noindex-nofollow/


If that is not the reason in your case, please provide more details like your website URL! :)

You can either post a followup here with additional details or use email:
http://www.microsystools.com/home/contact.php
« Last Edit: October 19, 2012, 11:25:56 AM by Webhelpforums »
TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

 




See Our Webmaster Tools for Windows and Mac

A1 Sitemap Generator
      
A1 Website Analyzer
      
A1 Keyword Research
      
A1 Website Download
      
A1 Website Search Engine
      
A1 Website Scraper