Abstract
Big data introduces new challenges to database systems because of its big-volume and big-velocity properties. Specially, the big velocity, i.e., data arrives very fast, requires that database systems have to provide efficient solutions to process continuously-arriving queries. However, traditional disk-based DBMSs have a large overhead in maintaining database consistency. This is mainly due to the logging, locking, and latching mechanisms inside traditional DBMSs. In this paper, we aim to reduce the logging overheads for DBMSs by using new kinds of storage media such as PCM. Particularly, we propose a latch-free logging scheme named LFLogging. It uses PCM for both updating and transaction logging in disk-based DBMSs. Different from the traditional approaches where latches contention and complex logging schemes like WAL, LFLogging provides high performance by reducing latches and explicit logging. We conduct trace-driven experiments on the TPC-C benchmark to measure the performance of our proposal. The results show that LFLogging achieves up to 4~5X improvement in system throughput than existing approaches including WAL and PCMLogging.
Keywords
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Larson, P.A., Blanas, S., Diaconu, C., Freedman, C., Patel, J.M., Zwilling, M.: High-performace concurrency control mechanisms for main-memory databases. PVLDB 5(4), 298–309 (2011)
Harizopoulos, S., Abadi, D., Madden, S., et al.: OLTP through the looking glass, and what we found there. In: SIGMOD, pp. 981–992 (2008)
Mohan, C., Haderle, D., Lindsay, B., et al.: ARIES: a transaction recovery method supporting fine-granularity locking and partial rollbacks using write-ahead logging. ACM Trans. Database Syst. (TODS) 17(1), 94–162 (1992)
Johnson, R., Pandis, I., Stoica, R., Athanassoulis, M., Ailamaki, A.: Aether: a scalable approach to logging. PVLDB 3(1), 681–692 (2010)
Helland, P., Sammer, H., Lyon, J., Carr, R., Garrett, P., Reuter, A.: Group commit timers and high volume transaction systems. In: Gawlick, D., Haynie, M., Reuter, A. (eds.) HPTS 1987. LNCS, vol. 359, pp. 301–329. Springer, Heidelberg (1989). doi:10.1007/3-540-51085-0_52
Fang, R., Hsiao, H.-I., He. B., Mohan, C., Wang, Y.: High-performance database logging using storage-class memory. In: ICDE, pp. 1221–1231 (2011)
Kawahara, T.: Scalable spin-transger torque Ram technology for normally-off computing. IEEE Des. Test Comput. 28(1), 52–63 (2011)
Wu, Z., Jin, P., Yue, L.: Efficient space management and wear leveling for PCM-based storage systems. In: ICA3PP, pp. 784–798 (2015)
Chen, K., Jin, P., Yue, L.: Efficient buffer management for PCM-enhanced hybrid memory architecture. In: APWeb, pp. 29–40 (2015)
Chen, S., Gibbons, P.B., Nath, S.: Rethinking database algorithms for phase-change memory. In: CIDR, pp. 21–31 (2011)
Gao, S., Xu, J., Härder, T., He, B., Choi, B., Hu, H.: PCMLogging: optimizing transaction logging and recovery performance with PCM. IEEE Trans. Knowl. Data Eng. 27(12), 3332–3346 (2015)
Soisalon-Soininen, E., Ylönen, T.: Partial strictness in two-phase locking. In: Gottlob, G., Vardi, M.Y. (eds.) ICDT 1995. LNCS, vol. 893, pp. 139–147. Springer, Heidelberg (1995). doi:10.1007/3-540-58907-4_12
Postgresql: Open source object-relational database system. http://www.postgresql.org/
BenchmarkSQL. http://www.sourceforge.net/projects/benchmarksql
Nam, Y.J., Park, C.: An adaptive high-low water mark destage algorithm for cached RAID5. In: PRDC, pp. 177–184 (2002)
Lee, B., Zhou, P., Yang, J., et al.: Phase-change technology and the future of main memory. IEEE Micro 30(1), 143 (2010)
Levandoski, J.J., Sengupta, S.: The BW-tree: a latch-free b-tree for log-structured flash storage. IEEE Data Eng. Bull. 36(2), 56–62 (2013)
Oh, G., Kim, S., Lee, S., et al.: Sqlite optimization with phase change memory for mobile applications. PVLDB 8(12), 1454–1465 (2015)
Arulraj, J., Perron, M., Pavlo, A.: Write-behind logging. PVLDB 10(4), 337–348 (2016)
Acknowledgements
This work is partially supported by the National Science Foundation of China under the grant numbers 61472376 and 61672479, the Fundamental Research Funds for the Central Universities, and a fund from the Science and Technology on Electronic Information Control Laboratory.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Wang, W., Jin, P., Wan, S., Yue, L. (2017). LFLogging: A Latch-Free Logging Scheme for PCM-Based Big Data Management Systems. In: Bao, Z., Trajcevski, G., Chang, L., Hua, W. (eds) Database Systems for Advanced Applications. DASFAA 2017. Lecture Notes in Computer Science(), vol 10179. Springer, Cham. https://doi.org/10.1007/978-3-319-55705-2_7
Download citation
DOI: https://doi.org/10.1007/978-3-319-55705-2_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-55704-5
Online ISBN: 978-3-319-55705-2
eBook Packages: Computer ScienceComputer Science (R0)