Carlos Bartolomeu
Luís Rodrigues
ABSTRACT
Conflict-free Replicated Data Types (CRDTs) are high-level data types that can be replicated with minimal coordination among replicas due to its confluent semantics. This property makes CRDTs specially appealing for geo-replicated settings. Different approaches, such as state transfer and operation forwarding, have been proposed to propagate updates among replicas, with different tradeoffs among the amount of network traffic generated and the staleness of local information. This paper proposes and evaluates techniques to automatically adapt a CRDT implementation, such that the best approach is used, based on the application needs (captured by a SLA) and the observed system configuration. Our techniques have been integrated in SwiftCloud, a state of the art geo-replicated store based on CRDTs.
- P. Almeida, A. Shoker, and C. Baquero. Efficient state-based CRDTs by delta-mutation. CoRR, abs/1410.2803, 2014.Google Scholar
- C. Baquero, P. Almeida, and A. Shoker. Making operation-based CRDTs operation-based. In K. Magoutis and P. Pietzuch, editors, Distributed Applications and Interoperable Systems, LNCS, pages 126--140. Springer Berlin Heidelberg, 2014. Google ScholarDigital Library
- A. Bieniusa, M. Zawirski, N. Preguiça, M. Shapiro, C. Baquero, V. Balegas, and S. Duarte. An optimized conflict-free replicated set. CoRR, abs/1210.3368, 2012.Google Scholar
- B. Cooper, A. Silberstein, E. Tam, R. Ramakrishnan, and R. Sears. Benchmarking cloud serving systems with YCSB. In SoCC, 2010. Google ScholarDigital Library
- M. Couceiro, G. Chandrasekara, M. Bravo, M. Hiltunen, P. Romano, and L. Rodrigues. Q-opt: Self-tuning quorum system for strongly consistent software defined storage. In Middleware '15, Vancouver, BC, Canada, 2015. Google ScholarDigital Library
- V. Hodge and J. Austin. A survey of outlier detection methodologies. Artificial Intelligence Review, 22(2):85--126, 2004. Google ScholarDigital Library
- R. Kalman. A new approach to linear filtering and prediction problems. Journal of Fluids Engineering, 82(1):35--45, 1960.Google ScholarCross Ref
- L. Lamport. The part-time parliament. ACM Trans. Comput. Syst., 16(2):133--169, May 1998. Google ScholarDigital Library
- M. Letia, N. Preguiça, and M. Shapiro. CRDTs: Consistency without concurrency control. CoRR, abs/0907.0929, 2009.Google Scholar
- W. Lloyd, M. Freedman, M. Kaminsky, and D. Andersen. Don't settle for eventual: Scalable causal consistency for wide-area storage with COPS. In SOSP, 2011. Google ScholarDigital Library
- A. Metwally, D. Agrawal, and A. El Abbadi. Efficient computation of frequent and top-k elements in data streams. In ICDT, volume 3363 of LNCS, pages 398--412. Springer, 2005. Google ScholarDigital Library
- D. Navalho, S. Duarte, N. Preguiça, and M. Shapiro. Incremental stream processing using computational conflict-free replicated data types. CloudDP, 2013. Google ScholarDigital Library
- E. Page. Continuous inspection schemes. Biometrika, 41(1/2):pp. 100--115, 1954.Google ScholarCross Ref
- N. Preguiça, J. Marques, M. Shapiro, and M. Letia. A commutative replicated data type for cooperative editing. In ICDCS, 2009.Google ScholarDigital Library
- M. Shapiro, N. Preguiça, C. Baquero, and M. Zawirski. A comprehensive study of Convergent and Commutative Replicated Data Types. Research Report RR-7506, 2011.Google Scholar
- M. Shapiro, N. Preguiça, C. Baquero, and M. Zawirski. Conflict-free replicated data types. SSS, 2011. Google ScholarDigital Library
- D. Terry, A. Demers, K. Petersen, M. Spreitzer, M. Theimer, and B. Welch. Session guarantees for weakly consistent replicated data. In PDIS, 1994. Google ScholarDigital Library
- D. Terry, V. Prabhakaran, R. Kotla, M. Balakrishnan, M. Aguilera, and H. Abu-Libdeh. Consistency-based service level agreements for cloud storage. SOSP, 2013. Google ScholarDigital Library
- W. Vogels. Eventually consistent. Commun. ACM, 52(1):40--44, Jan. 2009. Google ScholarDigital Library
- M. Zawirski, N. Preguiça, S. Duarte, A. Bieniusa, V. Balegas, and M. Shapiro. Write fast, read in the past: Causal consistency for client-side applications. Middleware, 2015. Google ScholarDigital Library
Index Terms
- Dynamic adaptation of geo-replicated CRDTs
Recommendations
Making CRDTs Byzantine fault tolerant
PaPoC '22: Proceedings of the 9th Workshop on Principles and Practice of Consistency for Distributed DataIt is often claimed that Conflict-free Replicated Data Types (CRDTs) ensure consistency of replicated data in peer-to-peer systems. However, peer-to-peer systems usually consist of untrusted nodes that may deviate from the specified protocol (i.e. ...
Improving the Reactivity of Pure Operation-Based CRDTs
PaPoC '21: Proceedings of the 8th Workshop on Principles and Practice of Consistency for Distributed DataModern distributed applications increasingly replicate data to guarantee both high availability of the system and an optimal user experience. Conflict-Free Replicated Data Types (CRDTs) are a family of data types specially designed for highly available ...
Memory efficient CRDTs in dynamic environments
VMIL 2019: Proceedings of the 11th ACM SIGPLAN International Workshop on Virtual Machines and Intermediate LanguagesModern distributed applications increasingly replicate data in order to guarantee both high availability of systems and an optimal user experience. Conflict-Free Replicated Data Types (CRDTs) are a family of data types specially designed for highly ...
Comments