skip to main content
10.1145/3210284.3219767acmconferencesArticle/Chapter ViewAbstractPublication PagesdebsConference Proceedingsconference-collections
poster

Log Pruning in Distributed Event-sourced Systems

Authors Info & Claims
Published:25 June 2018Publication History

ABSTRACT

Event sourcing is increasingly used and implemented in event-based systems for maintaining the evolution of application state. However, unbounded event logs are impracticable for many systems, as it is difficult to align scalability requirements and long-term runtime behavior with the corresponding storage requirements. To this end, we explore the design space of log pruning approaches suitable for event-sourced systems. Furthermore, we survey specific log pruning mechanisms for event-sourced logs. In a brief evaluation, we point out the trade-offs when applying pruning to event logs and highlight the applicability of log pruning to event-sourced systems.

References

  1. Gul Agha. 1986. Actors: A Model of Concurrent Computation in Distributed Systems. MIT Press, Cambridge, MA, USA. Google ScholarGoogle ScholarCross RefCross Ref
  2. Dominic Betts, Julian Dominguez, Grigori Melnik, Fernando Simonazzi, and Mani Subramanian. 2013. Exploring CQRS and Event Sourcing: A journey into high scalability availability and maintainability with Windows Azure. Microsoft. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Jonas Boner, Dave Farley, Roland Kuhn, and Martin Thompson. 2014. The Reactive Manifesto. http://www.reactivemanifesto.org/. (Sept. 2014). Accessed: 2018-02-18.Google ScholarGoogle Scholar
  4. Paul C. Bryan and Mark Nottingham. 2015. JavaScript Object Notation (JSON) Patch. RFC 6902. (14 Oct. 2015).Google ScholarGoogle Scholar
  5. Benjamin Erb, Gerhard Habiger, and Franz J Hauck. 2016. On the potential of event sourcing for retroactive actor-based programming. In First Workshop on Programming Models and Languages for Distributed Computing. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Benjamin Erb, Dominik Meißner, Gerhard Habiger, Jakob Pietron, and Frank Kargl. 2017. Consistent Retrospective Snapshots in Distributed Event-sourced Systems. In Conference on Networked Systems. Göttingen, Germany.Google ScholarGoogle Scholar
  7. Benjamin Erb, Dominik Meißner, Jakob Pietron, and Frank Kargl. 2017. Chronograph: A Distributed Processing Platform for Online and Batch Computations on Event-sourced Graphs. In Proceedings of the 11th ACM International Conference on Distributed and Event-based Systems. ACM, New York, NY, USA, 78--87. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Martin Fowler. 2005. Event Sourcing. http://martinfowler.com/eaaDev/EventSourcing.html. (Dec. 2005). Accessed: 2018-04-23.Google ScholarGoogle Scholar
  9. Gregor Hohpe. 2006. Programming Without a Call Stack - Event-driven Architectures. Technical Report. eaipatterns.com.Google ScholarGoogle Scholar
  10. Ivo Jimenez, Michael Sevilla, Noah Watkins, Carlos Maltzahn, Jay Lofstead, Kathryn Mohror, Andrea Arpaci-Dusseau, and Remzi Arpaci-Dusseau. 2017. The popper convention: Making reproducible systems evaluation practical. In Parallel and Distributed Processing Symposium Workshops (IPDPSW), 2017 IEEE International. IEEE, 1561--1570.Google ScholarGoogle ScholarCross RefCross Ref
  11. Martin Kleppmann. 2017. Designing Data-Intensive Applications. O'Reilly.Google ScholarGoogle Scholar
  12. Luc Moreau, Paul Groth, Simon Miles, Javier Vazquez-Salceda, John Ibbotson, Sheng Jiang, Steve Munroe, Omer Rana, Andreas Schreiber, Victor Tan, and Laszlo Varga. 2008. The Provenance of Electronic Data. Commun. ACM 51, 4 (April 2008), 52--58. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. J. Thönes. 2015. Microservices. IEEE Software 32, 1 (Jan 2015), 116--116.Google ScholarGoogle ScholarCross RefCross Ref
  14. Greg Young. 2010. CQRS Documents. https://cqrs.files.wordpress.com/2010/11/cqrs_documents.pdf. (Nov. 2010). Accessed: 2018-04-28.Google ScholarGoogle Scholar

Index Terms

  1. Log Pruning in Distributed Event-sourced Systems

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          DEBS '18: Proceedings of the 12th ACM International Conference on Distributed and Event-based Systems
          June 2018
          289 pages
          ISBN:9781450357821
          DOI:10.1145/3210284

          Copyright © 2018 Owner/Author

          Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 25 June 2018

          Check for updates

          Qualifiers

          • poster
          • Research
          • Refereed limited

          Acceptance Rates

          DEBS '18 Paper Acceptance Rate12of31submissions,39%Overall Acceptance Rate130of553submissions,24%

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader