Keeping downloads to one specific place

Started by webloader1, February 23, 2024, 05:43:18 AM

webloader1

Apologies if this is a stoopid question, but I've tried various solutions and cannot resolve my problem.

I am looking to download each sub-page from a site as a separate file, but the search seems to go off at a tangent.

Given that it is a .gov site, as you can imagine, my error results in lots of 'wrong' pages being downloaded.

The site is https://www.gov.uk/countryside-stewardship-grants which has 260 pages below it. It is only the 260 pages that I need to download, but I cannot see how to isolate those within the A1 options.

Can someone please advise where I am going wrong and how to resolve it?
Thanks.

Webhelpforums

When you say

QuoteThe site is https://www.gov.uk/countryside-stewardship-grants which has 260 pages below it.

Do you mean it has links to 260 pages you want or that all page URLs are below countryside-stewardship-grants/

Either way, many ways to achieve what you want:


  • Root path to https://www.gov.uk/
  • Add to start search paths: https://www.gov.uk/countryside-stewardship-grants
  • Limit "scan website | output filters" paths to :countryside-stewardship-grants


Relevant help pages:

https://www.microsystools.com/products/website-download/help/root-aliases-start-paths/

https://www.microsystools.com/products/website-download/help/website-crawler-output-filters/

https://www.microsystools.com/products/website-download/help/website-crawler-scanner-filters/

https://www.microsystools.com/products/website-download/help/crawl-robots-noindex-nofollow/


If you need help configuring a project file, you can also drop us an email:
https://www.microsystools.com/home/contact.php
TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

More About Our Webmaster Tools for Windows and Mac

HTML, image, video and hreflang XML sitemap generatorA1 Sitemap Generator
      
website analysis spider tool for technical SEOA1 Website Analyzer
      
SEO tools for managing keywords and keyword listsA1 Keyword Research
      
complete website copier toolA1 Website Download
      
create custom website search enginesA1 Website Search Engine
      
scrape data into CSV, SQL and databasesA1 Website Scraper