Can't crawl past the Home Page

Started by chenchbrain, November 02, 2016, 11:48:49 AM

chenchbrain

I'm trying to crawl: https://www.duracell.com/en-us/ but not getting past the HP of the site.  Any idea if some configuration options can be set to get through to the rest of the site?

Webhelpforums

Unforunately it appears the website depends entirely on AJAX to load navigation - I don't think you will find any sitemapper that will handle that.

It is on the todo list to try handle Ajax by loading a browser module - and then read conent after page load.

May or may be included in version 8.x

If it has interest - I may be able to provide a beta at an earlier time (Windows) - in that case drop an email:
http://www.microsystools.com/home/contact.php


TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

More About Our Webmaster Tools for Windows and Mac

HTML, image, video and hreflang XML sitemap generatorA1 Sitemap Generator
      
website analysis spider tool for technical SEOA1 Website Analyzer
      
SEO tools for managing keywords and keyword listsA1 Keyword Research
      
complete website copier toolA1 Website Download
      
create custom website search enginesA1 Website Search Engine
      
scrape data into CSV, SQL and databasesA1 Website Scraper