See Our Webmaster Tools for Windows and Mac

HTML, image, video and hreflang XML sitemap generatorA1 Sitemap Generator
      
website analysis spider tool for technical SEOA1 Website Analyzer
      
SEO tools for managing keywords and keyword listsA1 Keyword Research
      
complete website copier toolA1 Website Download
      
create custom website search enginesA1 Website Search Engine
      
scrape data into CSV, SQL and databasesA1 Website Scraper

How to restrict the scanning to only the URLs imported from text file?

  • 2 Replies
  • 21976 Views
*

mediterrano

  • Newbie
  • *
  • 1
  • +0/-0
    • View Profile
I import URLs to be scanned from file

File contains the below URLs:
http://www.example.com/details.aspx?ENOFI=01301085
http://www.example.com/details.aspx?ENOFI=02802247


The resulting scraped.csv contains:
http://www.example.com/details.aspx?enofi=01301085#
http://www.example.com/details.aspx?enofi=01301085&lang=de-ch#
http://www.example.com/details.aspx?enofi=01301085&lang=de-ch
http://www.example.com/details.aspx?enofi=01301085&lang=en-us#
http://www.example.com/details.aspx?enofi=01301085&lang=en-us
http://www.example.com/details.aspx?enofi=01301085&lang=fr-ch#
http://www.example.com/details.aspx?enofi=01301085&lang=fr-ch
http://www.example.com/details.aspx?enofi=01301085&lang=it-ch#
http://www.example.com/details.aspx?enofi=01301085&lang=it-ch
http://www.example.com/details.aspx?enofi=01301085&lang=zh-cn#
http://www.example.com/details.aspx?enofi=01301085&lang=zh-cn
http://www.example.com/details.aspx?enofi=01301085
http://www.example.com/details.aspx?enofi=02802247#
http://www.example.com/details.aspx?enofi=02802247&lang=de-ch#
http://www.example.com/details.aspx?enofi=02802247&lang=de-ch
http://www.example.com/details.aspx?enofi=02802247&lang=en-us#
http://www.example.com/details.aspx?enofi=02802247&lang=en-us
http://www.example.com/details.aspx?enofi=02802247&lang=fr-ch#
http://www.example.com/details.aspx?enofi=02802247&lang=fr-ch
http://www.example.com/details.aspx?enofi=02802247&lang=it-ch#
http://www.example.com/details.aspx?enofi=02802247&lang=it-ch
http://www.example.com/details.aspx?enofi=02802247&lang=zh-cn#
http://www.example.com/details.aspx?enofi=02802247&lang=zh-cn
http://www.example.com/details.aspx?enofi=02802247


But I want the scraped.csv to contain only the specified URLs:
http://www.example.com/details.aspx?ENOFI=01301085
http://www.example.com/details.aspx?ENOFI=02802247


How can I achieve this?

for screenshots of all relevant settings pages, just use the below DropBox-link
https://www.dropbox.com/sh/397h1wr8bdp3ank/AABNU9zayaBfjeYxrFUC3_SBa?dl=0
« Last Edit: March 26, 2021, 04:14:33 AM by Webhelpforums »

*

Webhelpforums

  • Administrator
  • Hero Member
  • *****
  • 1449
  • +6/-0
  • Shared between Microsys, WebHelpForums and helpers
    • View Profile
    • Webmaster and Website Help Forums
If I understand you correctly, your problem is that A1 Website Scraper scrapes from otherURLs you do not want scraped?

You have to limit the "analysis" and "output" to the wanted URLs.

See the help page for importing:
http://www.microsystools.com/products/website-scraper/help/scrape-content-pages-list/

Quote
If you only want the imported URLs checked/analyzed, tick the recrawl option.
If you do not use this option, A1 Website Scraper will perform a full crawl starting from the website root.
It is crucial to use this option in case:
You set limit include in analysis filters, e.g. by using the button as shown above.
You only want external URLs checked and/or analyzed.

If you continue to have problems, send and email with your project file:
http://www.microsystools.com/home/contact.php
« Last Edit: March 29, 2015, 04:51:26 PM by Webhelpforums »
TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

*

ApkJoycasphope

  • ApkJoycasphopeMF
  • Newbie
  • *
  • 8
  • +0/-0
    • View Profile
    • Full guide on sensitive casino sites
Re: How to restrict the scanning to only the URLs imported from text file?
« Reply #2 on: November 18, 2021, 09:22:03 PM »
The cleverness to install an online casino on a smartphone makes the gaming development more easy and does not join the player to a stationary computer, and remarkable PC programs get ready for a secure Internet connection. Gamblers are exhilarated to make use of such software to access gambling relaxation, so operators present oneself them functioning applications for smartphones and PCs. On this recto we enjoy unperturbed the best casino apps also in behalf of Android with a natural money game.
Many operators put forward without cost or obligation download of online casinos in behalf of Android 1win UA with a view genuine boodle with withdrawal to electronic wallets or bank cards. Expressive casinos are being developed as a service to the convenience of customers and attracting a larger audience. Such applications include a number of undeniable advantages:
 
Access to the casino from anywhere where there is Wi-Fi or plastic Internet. At the nonetheless ease, applications do not fasten on up much lacuna in the device's memory.
The functionality corresponds to the desktop construct of the resource: you can mobilize bonuses, participate in tournaments, ass in your account, fritz opening machines pro change in the application with the withdrawal of winnings, etc.
End-to-end registration. There is no have need of to additionally register from your phone if you acquire an strenuous account.
Free-born demos. Gamblers can float any video slot or meals game in a freed lawsuit mode.
The only impediment of the adaptation adapted for lightweight devices may be the non-appearance of some titles in the presented collection. The mobile appeal of an online casino with niche machines seeking playing to save loot gives access only to slots in HTML5 style, but so far not all providers have redesigned their portfolios in accordance with this requirement. Notwithstanding, the largest manufacturers own been producing groove machines for the benefit of certain years entrancing into account unfamiliar standards and remaking dilapidated titles for them, which are especially current total gamblers.
 
Furthermore, providers hire into account the features of portable devices when creating games. A unusual interface and odd modes of make use of are being developed after them. For example, Wazdan offers a special attraction that increases the battery control of the appliance by way of 40%, and Ultra Lite technology, which preserves the image quality and download hurriedness with a indisposed Internet connection. Opening machines on the phone beget no more than a start button and a gamble au fait with control.
 
The gaming interface on a matter-of-fact colander is slightly modified compared to the desktop manifestation, so it is certainly convenient to put on in the casino request for money from your phone, oversee slots and groove machines. The main menu is esoteric in drop-down windows, and links to the fundamental sections are secured at the top or origin of the screen. Also, the online chit-chat term button in the interest of contacting technical hold up specialists is each in sight.
 
Since the Google Court and AppStore digital distribution services intrude strict restrictions on gambling programs, you can download the casino application to your phone after playing real money from the verified website. To download, you require call a element to the apk complete and the purchaser's acquiescence to inaugurate and rove the program. Now operators transmit detailed ordination instructions on the page with a link, and if there are difficulties, the consumer can again consult with the customer service.
 
Some licensed casinos also forth clients programs someone is concerned intimate computers and laptops. You can Apk Casino them from the official website. Such software is renowned due to loose uninterrupted access to games from the desktop without using a browser.

 

Learn More About Our Webmaster Tools for Windows and Mac

HTML, image, video and hreflang XML sitemap generatorA1 Sitemap Generator
      
website analysis spider tool for technical SEOA1 Website Analyzer
      
SEO tools for managing keywords and keyword listsA1 Keyword Research
      
complete website copier toolA1 Website Download
      
create custom website search enginesA1 Website Search Engine
      
scrape data into CSV, SQL and databasesA1 Website Scraper