Carl Lagoze
ABSTRACT
Over three years ago, the Core Integration team of the National Science Digital Library (NSDL) implemented a digital library based on metadata aggregation using Dublin Core and OAI-PMH. The initial expectation was that such low-barrier technologies would be relatively easy to automate and administer. While this architectural choice permitted rapid deployment of a production NSDL, our three years of experience have contradicted our original expectations of easy automation and low people cost. We have learned that alleged "low-barrier" standards are often harder to deploy than expected. In this paper we report on this experience and comment on the general cost, the functionality, and the ultimate effectiveness of this architecture.
- Arms, C., Dushay, N., Foulonneau, M., et al., Best Practices for Shareable Metadata - DRAFT, http://comm.nsdl.org/download.php/653/ShareableMetadataBestPractices.docGoogle Scholar
- Arms, W.Y. Automated Digital Libraries: How Effectively Can Computers Be Used for the Skilled Tasks of Professional Librarianship? D-Lib Magazine, 6 (7/9).Google Scholar
- Arms, W.Y., Dushay, N., Fulker, D.W., et al. A Case Study in Metadata Harvesting: the NSDL. Library Hi Tech, 21 (2).Google Scholar
- Arms, W.Y., Hillmann, D., Lagoze, C., et al. A Spectrum of Interoperability: The Site for Science Prototype for the NSDL. D-Lib Magazine, 8 (1).Google Scholar
- Berners-Lee, T., Fielding, R. and Masinter, L. Uniform Resource Identifiers (URI): Generic Syntax. RFC, 2396, http://www.ietf.org/rfc/rfc2396.txt. Google ScholarDigital Library
- Broder, A. On the resemblance and containment of documents Compression, Complexity of Sequences, Positano, Italy, 1997, 21--29. Google ScholarDigital Library
- Bruce, T.R. and Hillmann, D. The Continuum of Metadata Quality: Defining, Expressing, Exploiting. in Hillmann, D. ed. Metadata in Practice, American Library Association, Chicago, 2004.Google Scholar
- Buchanan, G. and Hinze, A., A Generic Alerting Service for Digital Libraries. in JCDL 2005, (Tucson, AZ, 2005), ACM/IEEE, 131--140. Google ScholarDigital Library
- Cleverdon, C.W. and Keen, E.M. Factors Determining the Performance of Indexing Systems, Vol. 1: Design.Google Scholar
- Cleverdon, C.W. and Keen, E.M. Factors Determining the Performance of Indexing Systems, Vol. 2: Test Results.Google Scholar
- Cole, T.W. and Shreeves, S. Lessons Learned from the Illinois OAI Metadata Harvesting Project. in Hillmann, D. ed. Metadata in Practice, American Library Association, Chicago, 2004.Google Scholar
- Dushay, N. and Hillmann, D., Analyzing Metadata for Effective Use and Re-Use. in DCMI Metadata Conference and Workshop, (Seattle, 2003). Google ScholarDigital Library
- Dushay, N. and Hillmann, D., NSDL Metadata Primer, http://metamanagement.comm.nsdl.org/outline.htmlGoogle Scholar
- Fisher, R., Lugg, R. and Boese, K.C. Cataloging: how to take a business approach. The Bottom Line: Managing Library Finances, 17 (2). 50--54.Google ScholarCross Ref
- Foulonneau, M., Cole, T.W., Habing, T.G., et al., Using Collection Descriptions to Enhance an Aggregation of Harvested Item-Level Metadata. in Joint Conference on Digital Libraries (JCDL 2005), (Denver, 2005), ACM. Google ScholarDigital Library
- Hagedorn, K. OAIster: a "no dead ends" OAI service provider. Library Hi Tech, 21 (2). 170--181.Google ScholarCross Ref
- Halbert, M., Kaczmarek, J. and Hagedorn, K., Findings from the Mellon Metadata Harvesting Initiative. in Research and Advanced Technology for Digital Libraries: 7th European Conference, ECDL 2003, (Trondheim, Norway, 2003), Springer-Verlag.Google ScholarCross Ref
- Harrison, T.L., Elango, A., Bollen, J., et al. Initial Experiences Re-exporting Duplicate and Similarity Computations with an OAI-PMH Aggregator. arXiv Report, cs.DL/0401001,Google Scholar
- Hillmann, D., Dushay, N. and Phipps, J., Improving Metadata Quality: Augmentation and Recombination. in DC-2004, (Shanghai, China, 2004). Google ScholarDigital Library
- Lagoze, C., Arms, W., Gan, S., et al., Core Services in the Architecture of the National Digital Library for Science Education (NSDL). in Joint Conference on Digital Libraries, (Portland, Oregon, 2002), ACM/IEEE. Google ScholarDigital Library
- Lagoze, C., Krafft, D., Jesuroga, S., et al. An Information Network Overlay Architecture for the NSDL. arXiv/CoRR Report, cs.DL/0501080, http://arxiv.org/abs/cs.DL/0501080.Google Scholar
- Lagoze, C., Krafft, D.B., Payette, S., et al. What Is a Digital Library Anyway? Beyond Search and Access in the NSDL. D-Lib Magazine, 11 (11).Google Scholar
- Lagoze, C., Van de Sompel, H., Nelson, M., et al., Guidelines for Aggregators, Caches and Proxies, http://www.openarchives.org/OAI/2.0/guidelines-aggregator.htmGoogle Scholar
- Mason, J. and Sutton, S., Education Working Group: Draft Proposal, http://dublincore.org/documents/2000/10/05/education-namespace/Google Scholar
- Mitchell, S., Mooney, M., Mason, J., et al. iVia Open Source Virtual Library System. D-Lib Magazine, 9 (1).Google Scholar
- Saylor, J., NSDL COLLECTION DEVELOPMENT POLICY DRAFT v.030715, http://content.comm.nsdl.org/doc_tracker/docs_download.php?id=452Google Scholar
- Shreeves, S., Knutson, E.M., Stvilia, B., et al., Is "Quality" Metadata "Shareable" Metadata? The Implications of Local Metadata Practices for Federated Collections. in ACRL Twelfth National Conference, (Minneapolis, 2005), ALA.Google Scholar
- Warner, S. The OAI Data-Provider Registration and Validation Service. arXiv, cs.DL/0506010, http://arxiv.org/abs/cs.DL/0506010.Google Scholar
Index Terms
- Metadata aggregation and "automated digital libraries": a retrospective on the NSDL experience
Recommendations
Merging metadata: a sociotechnical study of crosswalking and interoperability
JCDL '10: Proceedings of the 10th annual joint conference on Digital librariesDigital library interoperability relies on the use of a common metadata format. However, implementing a common metadata format among multiple digital libraries is not always a straightforward exercise. This paper reviews some of the metadata issues that ...
Extracting and Ingesting DDI Metadata and Digital Objects from a Data Archive into the iRODS Extension of the NARA TPAP Using the OAI-PMH
E-SCIENCE '09: Proceedings of the 2009 Fifth IEEE International Conference on e-ScienceThis prototype demonstrated that the migration of collections between digital libraries and preservation data archives is now possible using automated batch load for both data and metadata. We used this capability to enable collection interoperability ...
Integrating ddi metadata into the nara transcontinental persistent archive prototype via the oai-pmh
JCDL '08: Proceedings of the 8th ACM/IEEE-CS joint conference on Digital librariesThe H.W. Odum Institute for Research in Social Science (Odum), the Renaissance Computing Institute (RENCI), and the School of Information and Library Science (SILS), all part of the University of North Carolina at Chapel Hill (UNC-CH), are collaborating ...
Comments