Can't crawl past the Home Page

  • 1 Replies
  • 847 Views
*

chenchbrain

  • Newbie
  • *
  • 1
  • +0/-0
    • View Profile
Can't crawl past the Home Page
« on: November 02, 2016, 11:48:49 AM »
I'm trying to crawl: https://www.duracell.com/en-us/ but not getting past the HP of the site.  Any idea if some configuration options can be set to get through to the rest of the site?

*

Webhelpforums

  • Administrator
  • Hero Member
  • *****
  • 1379
  • +6/-0
  • Shared between Microsys, WebHelpForums and helpers
    • View Profile
    • Webmaster and Website Help Forums
Re: Can't crawl past the Home Page
« Reply #1 on: November 03, 2016, 10:10:27 AM »
Unforunately it appears the website depends entirely on AJAX to load navigation - I don't think you will find any sitemapper that will handle that.

It is on the todo list to try handle Ajax by loading a browser module - and then read conent after page load.

May or may be included in version 8.x

If it has interest - I may be able to provide a beta at an earlier time (Windows) - in that case drop an email:
http://www.microsystools.com/home/contact.php


MicrosysTools.com | Website and SEO Software for webmasters | A1 Sitemap Generator, A1 Website Analyzer etc.

 




See Our Webmaster Tools for Windows and Mac

A1 Sitemap Generator
      
A1 Website Analyzer
      
A1 Keyword Research
      
A1 Website Download
      
A1 Website Search Engine
      
A1 Website Scraper