Skip files that are over a certain size ?

  • 1 Replies


  • Newbie
  • *
  • 2
  • +0/-0
    • View Profile
Skip files that are over a certain size ?
« on: June 06, 2019, 02:11:38 PM »
On-the-fly while crawling,to avoid empty files. 



  • Administrator
  • Hero Member
  • *****
  • 1421
  • +6/-0
  • Shared between Microsys, WebHelpForums and helpers
    • View Profile
    • Webmaster and Website Help Forums
Re: Skip files that are over a certain size ?
« Reply #1 on: June 10, 2019, 06:08:21 AM »
You want options for skipping files over and/or under a certain file size?

One note though: Some sites still use e.g. a 1px x 1px transparent gif file (oldschool HTML trick for forcing browsers to render tables correctly) - but just to point out there may be legitimate very small files in a  website - the example I have is just one.

I do understand skipping over large files. Adding todo list to add such an option to "Scan website | Output filters" 
TechSEO360 |  | A1 Sitemap Generator, A1 Website Analyzer etc.


See Our Webmaster Tools for Windows and Mac

A1 Sitemap Generator
A1 Website Analyzer
A1 Keyword Research
A1 Website Download
A1 Website Search Engine
A1 Website Scraper