Search the World's Largest Database of Information Science & Technology Terms & Definitions
InfInfoScipedia LogoScipedia
A Free Service of IGI Global Publishing House
Below please find a list of definitions for the term that
you selected from multiple scholarly research resources.

What is Crawler

Encyclopedia of Information Science and Technology, Third Edition
A software program hosted online or locally that manages the capture of web content.
Published in Chapter:
Web Archiving
Trevor Alvord (Brigham Young University, USA)
DOI: 10.4018/978-1-4666-5888-2.ch757
Abstract
Web Archiving is an emerging and growing field in Information Science and Technology; not even out of its second decade yet playing a critical role in the documentation and preservation of the human experience portrayed on the Internet. With an estimated 72 hours of video uploaded to YouTube every minute and over 300 million images added to Facebook daily the Internet has by far become the preferred method for documenting ones life; traditional mediums such as journals and scrapbooks have given way to blogs and Flickr accounts. This article explores the history, issues—such as appraisal, metadata, and copyright—uses, and the developing lexicon of web archiving while examining current tools and services available in the field.
Full Text Chapter Download: US $37.50 Add to Cart
More Results
Spatial Search Engines
Also known as robot or spider, it is a module of a search engine that is responsible for visiting Web sites and extracting their content to be further indexed by the search engine.
Full Text Chapter Download: US $37.50 Add to Cart
The Impact of News on Public-Private Partnership Stock Price in China via Text Mining Method
Crawlers or web crawlers, also known as web spiders, are web bots that automatically allow users browse the World Wide Web. Web crawlers let users save the pages they visit so that search engines can generate indexes afterwards for use.
Full Text Chapter Download: US $37.50 Add to Cart
Search Engines: Past, Present, and Future
An essential part of a search engine which “crawls” the Web, using its linked structure to find webpages which can be analyzed and stored in a search engine’s index.
Full Text Chapter Download: US $37.50 Add to Cart
Seek and Ye Shall Find
Program or script which methodically browses databases collecting data about its elements
Full Text Chapter Download: US $37.50 Add to Cart
Search Engines: Past, Present and Future
An essential part of a search engine which “crawls” the Web, using its linked structure to find web pages which can be analyzed and stored in a search engine’s index.
Full Text Chapter Download: US $37.50 Add to Cart
Seek and Ye Shall Find
Program or script which methodically browses databases collecting data about its elements
Full Text Chapter Download: US $37.50 Add to Cart
eContent Pro Discount Banner
InfoSci OnDemandECP Editorial ServicesAGOSR