What is a spider?

Started by sneha1234, March 10, 2012, 03:22:20 AM

sneha1234

Spider is an robot that travels the web examining the websites in order to add them to a search engine database and rank them according to the specific ranking criteria for that search engine. The spiders will periodically come back to your site once indexed in their database. That is why it is important to constantly refresh your content, because the spiders will stop coming to your site if your content remains the same.


AllenSantiago

Spider or crawler is basically algorithm/program and used find/discover new and updated content/web pages and then places such content in to the search engine result pages.

lillianabe

Spider is known as search engine crawler or bot. Spider is one type of program which one use by all search engines for crawling or indexing website. Spider works to read or refers website or web page content or information and also new update and submitted to their owner or search engine data directory.

firstservicesnevda

Spider or crawler is basically algorithm/program and used find/discover new and updated content/web pages and then places such content in to the search engine result pages.

Nichole Green

Spider is also known as a bot, robot, or crawler. Spiders are programs used by a search engine to explore the World Wide Web in an automated manner and download the HTML content (not including graphics) from web sites, strip out whatever it considers superfluous and redundant out of the HTML, and store the rest in a database (i.e. its index).

tarunjangra

Spider is known as search engine .  A spider is a program that visits Web sites and reads their pages and other information in order to create entries for a search engine .

ericfox

 According to me a spider, also known as a robot or a crawler, is actually just a program that follows, or "crawls", links throughout the Internet, grabbing content from sites and adding it to search engine indexes. Spiders find Web pages by following links from other Web pages, but you can also submit your Web pages directly to a search engine or directory and request a visit by their spider.

maxsamuel

A spider is know as automatic software which index the web pages on an interval and update it in search engine database and crawl it time to time. this help to identify search engine for ranking it.

siyajoshi

Hello..
A spider is a program that a search engine uses to seek out information on the World Wide Web, as well as to index the information that it finds so that actual search results appear when a search query for a keyword is entered. The search engine spider "reads" the text on the web page or collection of web pages, and records any hyperlinks it finds. The search engine spider then follows these URLs, spiders those pages, and collects all the data by saving copies of the web pages into the index of the search engine for use by visitors.
Thnx...

Riyaraj

hi,

spider is a software.
Spiders follow links from one page to another and from one site to another. That is the primary reason why links to your site are so critical. Getting links to your website from other websites will give the search engine spiders more opportunities to find and re-index your site. The more times they find links to your site, the more times they will stop by and visit.

ruby

Spider or crawler is basically algorithm and used find new and updated web pages and then places such content in to the search engine result pages.

josshray

Spider is a bot which crawl a site or go though our sites.

petersmith5544

A spider crawls any website or web pages throughout on the web and puts to the search engine database. It is also known as crawlers, bot and robot.

jimmyedword

You can call it spider, bot, robot, crawler or a automated Google program.

ushahm

spider is also called as crawler or bot.search engine bots visit your website,read the content and save it as a document and show you to the search engine results.

icecube media

Hello,

A program that automatically fetches Web pages. Spiders are used to feed pages to search engines. It's called a spider because it crawls over the Web. Another term for these programs is webcrawler.

phpdevelopment

A spider is a program that visits Web sites and reads their pages and other information in order to create entries for a search engine index.
http://www.phpdevelopmentoutsourcing.com/cs-cart-development-india.php

Seo gurgaon

Spider or Crawler is the universal name of Program of Search Engines that crawl the world wide web through one link to another and fetch all the new information & index it into its Search Engine Database.

Webhelpforums

Our website auditing (links, anchor text, content etc.) tool A1 Website Analyzer http://www.microsystools.com/products/website-analyzer/ is an example of a program containing a website crawler / website spider
TechSEO360 | MicrosysTools.com  | A1 Sitemap Generator, A1 Website Analyzer etc.

Alex Thompson



    Search engines gather data about a website by 'sending' the spider or bots to 'read' the site and copy its content. This content is stored in the search engine's database. As they copy and absorb content from one document, they create record links and send other bots to make copies of content on those linked documents this process goes on and on.


jamesmiller

A Spider is a search engine's software, which reads the world wide websites for indexing the data of the websites into the search engines database.

TommyBenvolio

Basically Spider is a bot or crawler that will crawl your website through search engine.

roger4321

spider is a crawler which comes to the site and ranks the keywords by seeing the quality of back links from the site.

exportersindia

A spider is a program that visits Web sites and reads their pages to create entries for a search engine index.

More About Our Webmaster Tools for Windows and Mac

HTML, image, video and hreflang XML sitemap generatorA1 Sitemap Generator
      
website analysis spider tool for technical SEOA1 Website Analyzer
      
SEO tools for managing keywords and keyword listsA1 Keyword Research
      
complete website copier toolA1 Website Download
      
create custom website search enginesA1 Website Search Engine
      
scrape data into CSV, SQL and databasesA1 Website Scraper