How To Use of Robot.txt File In Webmaster..?

  • 2 Replies
  • 65 Views
*

pihu147741

  • Full Member
  • ***
  • 104
  • +0/-0
    • View Profile
    • Best Astrology Solution
How To Use of Robot.txt File In Webmaster..?
« on: February 05, 2019, 12:26:14 AM »
Hello friends,

I Want to Know that How To Use of Robot.txt File In Webmaster..?

*

clarac12

  • Newbie
  • *
  • 17
  • +0/-0
    • View Profile
    • list of mobile application development companies in dubai
Re: How To Use of Robot.txt File In Webmaster..?
« Reply #1 on: February 05, 2019, 03:55:17 AM »
Add your website link which doesn't want to crawl and index by Google search engine.

*

RH-Calvin

  • Hero Member
  • *****
  • 1260
  • +0/-0
    • View Profile
    • Reprise Hosting
Re: How To Use of Robot.txt File In Webmaster..?
« Reply #2 on: February 06, 2019, 02:06:18 AM »
Robots.txt is a text file that lists webpages which contain instructions for search engines robots. The file lists webpages that are allowed and disallowed from search engine crawling.
Cheap VPS | $1 VPS Hosting
Cheap Dedicated Servers | Free Setup with IPMI

 




See Our Webmaster Tools for Windows and Mac

A1 Sitemap Generator
      
A1 Website Analyzer
      
A1 Keyword Research
      
A1 Website Download
      
A1 Website Search Engine
      
A1 Website Scraper