Chengyu Fan
ABSTRACT
Many scientific domains, such as climate science and High Energy Physics (HEP), have data management requirements that are not well supported by the IP network architecture. Named Data Networking (NDN) is a new network architecture whose service model is better aligned with the needs of data-oriented applications. NDN provides features such as best-location retrieval, caching, load sharing, and transparent failover that would otherwise be painstakingly (re-)implemented by each application using point-to-point semantics in an IP network.
We present the first scientific data management application designed and implemented on top of NDN. We use this application to manage climate and HEP data over a dedicated, high-performance, testbed. Our application has two main components: a UI for dataset discovery queries and a federation of synchronized name catalogs. We show how NDN primitives can be used to implement common data management operations such as publishing, search, efficient retrieval, and publication access control.
- A. Hanushevsky, Potential Data Access Architectures using xrootd. http://xrootd.org/presentations/OSGAHM_1103.Plenary.pptx.Google Scholar
- Globus, www.globus.org.Google Scholar
- ndn-atmos, https://github.com/named-data/ndn-atmos.Google Scholar
- openDAP, www.opendap.org.Google Scholar
- 4th annual Earth System Grid Federation and Ultrascale Visualization Climate Data Analysis Tools face-to-face conference report. Technical Report LLNL-TR-666753, Lawrence Livermore National Laboratory, Livermore, CA, 2014.Google Scholar
- L. Cinquini, D. Crichton, C. Mattmann, J. Harney, G. Shipman, F. Wang, R. Ananthakrishnan, N. Miller, S. Denvil, M. Morgan, et al. The earth system grid federation: An open infrastructure for access to distributed geospatial data. Future Generation Computer Systems, 36:400--417, 2014.Google ScholarCross Ref
- A. Dorigo, P. Elmer, F. Furano, and A. Hanushevsky. Xrootd-a highly scalable architecture for data access. WSEAS Transactions on Computers, 1(4.3), 2005.Google Scholar
- C. Guok, D. Robertson, M. Thompson, J. Lee, B. Tierney, and W. Johnston. Intra and interdomain circuit provisioning using the oscars reservation system. In Broadband Communications, Networks and Systems, 2006. BROADNETS 2006. 3rd International Conference on, pages 1--8. IEEE, 2006.Google Scholar
- K. E. Taylor, V. Balaji, S. Hankin, M. Juckes, B. Lawrence, and S. Pascoe. Cmip5 data reference syntax (drs) and controlled vocabularies, 2010.Google Scholar
- K. E. Taylor, R. J. Stouffer, and G. A. Meehl. An overview of cmip5 and the experiment design. Bulletin of the American Meteorological Society, 93(4):485--498, 2012.Google ScholarCross Ref
- C. Yi, A. Afanasyev, I. Moiseenko, L. Wang, B. Zhang, and L. Zhang. A case for stateful forwarding plane. Computer Communications, 36(7):779--791, 2013. Google ScholarDigital Library
- L. Zhang, A. Afanasyev, J. Burke, V. Jacobson, P. Crowley, C. Papadopoulos, L. Wang, B. Zhang, et al. Named data networking. ACM SIGCOMM Computer Communication Review, 44(3):66--73, 2014. Google ScholarDigital Library
- Z. Zhu and A. Afanasyev. Let's chronosync: Decentralized dataset state synchronization in named data networking. In Network Protocols (ICNP), 2013 21st IEEE International Conference on, pages 1--10. IEEE, 2013.Google ScholarCross Ref
Index Terms
- Managing scientific data with named data networking
Recommendations
Named data networking on a router: fast and dos-resistant forwarding with hash tables
ANCS '13: Proceedings of the ninth ACM/IEEE symposium on Architectures for networking and communications systemsNamed data networking (NDN) is a new networking paradigm using named data instead of named hosts for communication. Implementation of scalable NDN packet forwarding remains a challenge because NDN requires fast variable-length hierarchical name-based ...
Named data networking on a router: forwarding at 20gbps and beyond
Named data networking (NDN) is a new networking paradigm using named data instead of named hosts for communication. Implementation of scalable NDN packet forwarding remains a challenge because NDN requires fast variable-length hierarchical name-based ...
Named data networking on a router: forwarding at 20gbps and beyond
SIGCOMM '13: Proceedings of the ACM SIGCOMM 2013 conference on SIGCOMMNamed data networking (NDN) is a new networking paradigm using named data instead of named hosts for communication. Implementation of scalable NDN packet forwarding remains a challenge because NDN requires fast variable-length hierarchical name-based ...
Comments