Skip files that are over a certain size ?

Started by kamenz.germany, June 06, 2019, 02:11:38 PM

kamenz.germany

On-the-fly while crawling,to avoid empty files. 

Webhelpforums

You want options for skipping files over and/or under a certain file size?

One note though: Some sites still use e.g. a 1px x 1px transparent gif file (oldschool HTML trick for forcing browsers to render tables correctly) - but just to point out there may be legitimate very small files in a  website - the example I have is just one.

I do understand skipping over large files. Adding todo list to add such an option to "Scan website | Output filters" 
TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

More About Our Webmaster Tools for Windows and Mac

HTML, image, video and hreflang XML sitemap generatorA1 Sitemap Generator
      
website analysis spider tool for technical SEOA1 Website Analyzer
      
SEO tools for managing keywords and keyword listsA1 Keyword Research
      
complete website copier toolA1 Website Download
      
create custom website search enginesA1 Website Search Engine
      
scrape data into CSV, SQL and databasesA1 Website Scraper