Can't crawl past the Home Page

  • 1 Replies


  • Newbie
  • *
  • 1
  • +0/-0
    • View Profile
Can't crawl past the Home Page
« on: November 02, 2016, 11:48:49 AM »
I'm trying to crawl: but not getting past the HP of the site.  Any idea if some configuration options can be set to get through to the rest of the site?



  • Administrator
  • Hero Member
  • *****
  • 1390
  • +6/-0
  • Shared between Microsys, WebHelpForums and helpers
    • View Profile
    • Webmaster and Website Help Forums
Re: Can't crawl past the Home Page
« Reply #1 on: November 03, 2016, 10:10:27 AM »
Unforunately it appears the website depends entirely on AJAX to load navigation - I don't think you will find any sitemapper that will handle that.

It is on the todo list to try handle Ajax by loading a browser module - and then read conent after page load.

May or may be included in version 8.x

If it has interest - I may be able to provide a beta at an earlier time (Windows) - in that case drop an email:

TechSEO360 |  | A1 Sitemap Generator, A1 Website Analyzer etc.


See Our Webmaster Tools for Windows and Mac

A1 Sitemap Generator
A1 Website Analyzer
A1 Keyword Research
A1 Website Download
A1 Website Search Engine
A1 Website Scraper