Welcome to the InfoSci Platform
Reference Hub8
A Novel Architecture for Deep Web Crawler

A Novel Architecture for Deep Web Crawler

Dilip Kumar Sharma, A. K. Sharma
Copyright: © 2011 |Volume: 6 |Issue: 1 |Pages: 24
ISSN: 1554-1045|EISSN: 1554-1053|EISBN13: 9781613507810|DOI: 10.4018/jitwe.2011010103
Cite Article Cite Article

MLA

Sharma, Dilip Kumar, and A. K. Sharma. "A Novel Architecture for Deep Web Crawler." IJITWE vol.6, no.1 2011: pp.25-48. http://doi.org/10.4018/jitwe.2011010103

APA

Sharma, D. K. & Sharma, A. K. (2011). A Novel Architecture for Deep Web Crawler. International Journal of Information Technology and Web Engineering (IJITWE), 6(1), 25-48. http://doi.org/10.4018/jitwe.2011010103

Chicago

Sharma, Dilip Kumar, and A. K. Sharma. "A Novel Architecture for Deep Web Crawler," International Journal of Information Technology and Web Engineering (IJITWE) 6, no.1: 25-48. http://doi.org/10.4018/jitwe.2011010103

Export Reference

Mendeley
Favorite Full-Issue Download

Abstract

A traditional crawler picks up a URL, retrieves the corresponding page and extracts various links, adding them to the queue. A deep Web crawler, after adding links to the queue, checks for forms. If forms are present, it processes them and retrieves the required information. Various techniques have been proposed for crawling deep Web information, but much remains undiscovered. In this paper, the authors analyze and compare important deep Web information crawling techniques to find their relative limitations and advantages. To minimize limitations of existing deep Web crawlers, a novel architecture is proposed based on QIIIEP specifications (Sharma & Sharma, 2009). The proposed architecture is cost effective and has features of privatized search and general search for deep Web data hidden behind html forms.

Request Access

You do not own this content. Please login to recommend this title to your institution's librarian or purchase it from the IGI Global bookstore.