Skip to main content

Calibration of a DBMS cost model with the software testpilot

  • Query Processing
  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1006))

Abstract

Relational database systems come with a query optimizer to plan the execution order of individual operators using a cost model of the underlying system. Despite the large body of research on optimization rules and cost approximation, little effort has been invested in the design of effective techniques for their validation. In this paper we discuss a method to calibrate cost models using the Software Testpilot, a performance assessment tool. The approach is based on taking an initial cost model and to refine it using the capabilities of the underlying DBMS kernel using automatically generated experiments. Apart from simplifying a time consuming task, it improves the effectiveness of the query optimizer by being tuned towards its hardware platform. The technique is illustrated for a novel parallel DBMS, called DBS3.

This is a preview of subscription content, log in via an institution.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. F. Andres “A Multi-Environment Cost Evaluator for Parallel DBMSs” PhD Thesis, University of PARIS VI, 1993.

    Google Scholar 

  2. D. Batory, “Extensible Cost Models and Query Optimization in Genesis”, IEEE Database Engineering, 1986, 10:4.

    Google Scholar 

  3. L. Becker, and R. H. Guting “Rule-based Optimization and Query Processing in an Extensible Geometric Database System”, ACM Transaction on Database Systems, 17 (1992), pp 247–303.

    Article  Google Scholar 

  4. B.Bergsten, M. Couprie, and P. Valduriez “Prototyping DBS3, a Shared-Memory Parallel Database System”, in Proc.1st Int. Conf. on Parallel and Distributed Information Systems, Miami, Florida, 1991.

    Google Scholar 

  5. S. Christodulakis “Implications of Certain Assumptions in Database Performance Evaluation”, ACM Trans. on Database syst., 9 (1984), pp. 163–186.

    Article  Google Scholar 

  6. W. Du, R. Krishnamurthy, and M. Shan “Query Optimization in Heterogeneous DBMS”, in Proceedings of the 18th VLDB conference, Vancouver, British Columbia, Canada, 1992.

    Google Scholar 

  7. S. L. Gaede “Tools for research in Computer Workload Characterization and modeling”, in experimental Comp. Performance and Evaluation, North holland, Amsterdam, 1981.

    Google Scholar 

  8. S. Ganguly, W. hasan, and R. Krishnamurthy “Query Optimisation for parallel Execution” in Procs. ACM SIGMOD 1992, pp 9–18.

    Google Scholar 

  9. W. Goldgewicht “DBA*Expert”, report, Bull, France, 1992.

    Google Scholar 

  10. G. Graefe and D. Dewitt “The EXODUS Optimizer Generator” In Procs of ACM-SIGMOD International Conference on Management of Data, 187, pp 160–172.

    Google Scholar 

  11. W. Hong and M. Stonebraker “Optimization of Parallel Query Execution plans in XPRS” in Proceeding of Int. Symposium on Parallel and Distributed Information Systems, 1992, pp 218–225.

    Google Scholar 

  12. R. Krishnamurthy, H. Boral, and C. Zaniolo “Optimization of non-recursive Queries”, in Proc. 12th Int. Conf. of Very Large DataBases, Kyoto, Japan,1986, pp 128–137.

    Google Scholar 

  13. M.L. Kersten, and F. Kwakkel, “Design and Implementation of a DBMS Performance Assessment Tool”, In Proceedings of the 4th Int. DEXA Conference, Prague, Czech republic, 1993, pp 265–276.

    Google Scholar 

  14. R. P. Kooi “The Optimization of Queries in Relational Databases” PhD Thesis, Case Western Reservie University, 1980.

    Google Scholar 

  15. R.S.G. Lanzelotte,P. Valduriez, and M.Zait “Optimization of multiway join queries for parallel execution”, in Proc. 19 th Int. Conf. on Very Large Data Bases, Dublin, Ireland, 1993, pp 493–504.

    Google Scholar 

  16. L. Mackert and G. Lohman “R* optimizer validation and performance evaluation for local queries”, in ACM SIGMOD International Conf. on Management of Data, 1986, pp. 84–95.

    Google Scholar 

  17. K. Mcdonell “Benchmark Frameworks and Tools for modelling the Workload profile”, in Proceedings of the 6th Int. Conf. on Modelling Techniques and Tools for Computer Performance Evaluation, 1992.

    Google Scholar 

  18. H. Pirahesh, J. M. Hellerstein, and W. Hasan ”Extensible/Rule Based Query Rewrite Optimization”, in Procs. ACM SIGMOD, 1992, pp 39–48.

    Google Scholar 

  19. S. Salza and R. Tomasso “ A modelling Tool for the performance analysis of relational database applications” in Proc. 6th Int. Conf. on Modelling Techniques and Tools for Computer Performance Evaluation, 1992.

    Google Scholar 

  20. P. Selinger, M. Astrahan, D. Chamberlin, R. Lorie and T. Price,“Access path Selection in a Relational Database Management Systems”, in Procs. ACM SIGMOD, 1979, pp 23–34.

    Google Scholar 

  21. M. Stonebraker, and G. Kemnitz, “The POSTGRES next-generation database management system”, Comm. of ACM, Special Section on Next-Generation Database Systems, 1991, 34(10):78.

    Google Scholar 

  22. A. Swami “Optimization of Large Join Queries”, PhD Thesis, Stanford University, June 1989, Stanford CS Report STAN-CS-89-1262.

    Google Scholar 

  23. C. Turbyfill, C. Ori, and D. Bitton “AS3AP — An ANSI Sequel Standard Scalable and Portable Benchmark for Relational Database Systems”, DB Sotfware Corporation, 1989.

    Google Scholar 

  24. K-Y Whang “Query Optimization in OBE/QBE A Memory-Resident Domain relational Calculus Database Systems”, Tech. Rep. RC11571 IBM Research Division, March 1987.

    Google Scholar 

  25. A. N. Wilschut, J. Flokstra, and P. M.G. Apers “Parallel Evaluation of multi-join queries”, in Procs. ACM SIGMOD, 1995, pp 115–126.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Subhash Bhalla

Rights and permissions

Reprints and permissions

Copyright information

© 1995 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Andrès, F., Kwakkel, F., Kersten, M.L. (1995). Calibration of a DBMS cost model with the software testpilot. In: Bhalla, S. (eds) Information Systems and Data Management. CISMOD 1995. Lecture Notes in Computer Science, vol 1006. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-60584-3_24

Download citation

  • DOI: https://doi.org/10.1007/3-540-60584-3_24

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-60584-3

  • Online ISBN: 978-3-540-47799-0

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics