ACM Home Page
Please provide us with feedback. Feedback
DP9: an OAI gateway service for web crawlers
Full text pdf formatPdf (126 KB)
Source International Conference on Digital Libraries archive
Proceedings of the 2nd ACM/IEEE-CS joint conference on Digital libraries table of contents
Portland, Oregon, USA
SESSION: Federating and harvesting metadata table of contents
Pages: 283 - 284  
Year of Publication: 2002
ISBN:1-58113-513-0
Authors
Xiaoming Liu  Old Dominion University, Norfolk, VA
Kurt Maly  Old Dominion University, Norfolk, VA
Mohammad Zubair  Old Dominion University, Norfolk, VA
Michael L. Nelson  NASA Langley Research Center, Hampton, VA
Sponsor
ACM: Association for Computing Machinery
Publisher
ACM  New York, NY, USA
Bibliometrics
Downloads (6 Weeks): 1,   Downloads (12 Months): 28,   Citation Count: 4
Additional Information:

abstract   references   cited by   index terms   collaborative colleagues   peer to peer  

Tools and Actions: Review this Article  
Save this Article to a Binder    Display Formats: BibTex  EndNote ACM Ref   
DOI Bookmark: Use this link to bookmark this Article: http://doi.acm.org/10.1145/544220.544284
What is a DOI?

ABSTRACT

Many libraries and databases are closed to general-purpose Web crawlers, and they expose their content only through their own search engines. At the same time many researchers attempt to locate technical papers through general-purpose Web search engines. DP9 is an open source gateway service that allows general search engines, (e.g. Google, Inktomi) to index OAI-compliant archives. DP9 does this by providing consistent URLs for repository records, and converting them to OAI queries against the appropriate repository when the URL is requested. This allows search engines that do not support the OAI protocol to index the "deep Web" contained within OAI compliant repositories.


REFERENCES

Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.

 
1
M. K. Bergman. The Deep Web: Surfacing Hidden Value. Journal of Electronic Publishing, 7(1), 2001
 
2
3
 
4
X. Liu, K. Maly, M. Zubair, and M. L. Nelson. Arc - An OAI Service Provider for Digital Library Federation, D-Lib Magazine 7(4), April 2001
 
5
M. Koster. The Web Robots Page. Available at http://info.webcrawler.com/mak/projects/robots/robots.html
 
6
OAI Perl. Available at http://oai-perl.sourceforge.net/


Collaborative Colleagues:
Xiaoming Liu: colleagues
Kurt Maly: colleagues
Mohammad Zubair: colleagues
Michael L. Nelson: colleagues

Peer to Peer - Readers of this Article have also read: