Skip to main content
SpringerLink
Log in

Characterizing and Predicting Resource Demand by Periodicity Mining

  • Published:
Journal of Network and Systems Management Aims and scope Submit manuscript

Abstract

We present algorithms for characterizing the demand behavior of applications and predicting demand by mining periodicities in historical data. Our algorithms are change-adaptive, automatically adjusting to new regularities in demand patterns while maintaining low algorithm running time. They are intended for applications in scientific computing clusters, enterprise data centers, and Grid and Utility environments that exhibit periodical behavior and may benefit significantly from automation. A case study incorporating data from an enterprise data center is used to evaluate the effectiveness of our technique.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. J. Rolia, A. Andrzejak, and M. Arlitt, Automating Enterprise Application Placement in Resource Utilities, in Proceedings of the 14th IFIP/IEEE Workshop on Distributed Systems: Operations and Management (DSOM 2003). Heidelberg, Germany, October 2003.

  2. J. Rolia, X. Zhu, M. Arlitt, and A. Andrzejak. Statistical Service Assurances for Applications in Utility Grid Environments, Performance Evaluation Journal, Volume 58, No. 2–3, Elsevier, Holland, pp. 319–339, 2004.

  3. S. Ma and J. L. Hellerstein, Mining Partially Periodic Event Patterns With Unknown Periods, in ICDE 2001, pp. 205–214.

  4. G. Casella and R. L. Berger, Statistical Inference, 2nd edn., Duxbury Press, 2001.

  5. J. A. Skicewicz and P. A. Dinda, Tsunami: A Wavelet Toolkit for Distributed Systems, in Tech. Rep. NWU-CS-03-16, Department of Computer Science, Northwestern University, Evanston, Illinois, 2003.

  6. J. Han, G. Dong, and Y. Yin, Efficient Mining of Partial Periodic Patterns in Time Series Database, in Proceedings of the 15th International Conference on Data Engineering, Sydney, Australia, pp. 106–115, 1999.

  7. J. Yang, W. Wang, and P. S. Yu. Discovering High Order Periodic Patterns. Knowledge and Information Systems, Vol. 6, No. 3, May 2004, pp. 243–268.

    Google Scholar 

  8. J. Hollingsworth and S. Maneewongvatana, Imprecise Calendars: An Approach to Scheduling Computational Grids, in Proceedings of the International Conference on Distributed Compting Systems, Austin, Texas, pp. 352–359, June 1–4, 1999.

  9. W. Enders, Applied Econometric Time Series, 2nd edn., Wiley, Mississauga, Ontario, Canada, 2003.

    Google Scholar 

  10. L. W. Russell, S. P. Morgan, and E. G. Chron. Clockwork: A New Movement in Autonomic Systems, IBM Systems Journal, Vol. 42, No. 1, 2003.

  11. P. A. Dinda, Resource Signal Prediction and Its Application to Real-time Scheduling Advisors, Ph.D. thesis, CMU, 2000.

  12. P. A. Dinda, An Extensible Toolkit for Resource Prediction in Distributed Systems (RPS). http://www.cs.nwu.edu/RPS/

  13. D. Dentscheva and W. Römisch, Optimal Power Generation under Uncertainty via Stochastic Programming. in K. Marti (ed.), Numerical Techniques and Engineering Applications, Lecture Notes in Economics and Mathematical Systems, Springer-Verlag, Berlin, 1997.

    Google Scholar 

  14. Y. Qiao, J. Skicewicz, and P. Dinda, Multiscale Predictability of Network Traffic, in Tech. Rep. NWU-CS-02-13, Department of Computer Science, Northwestern University, Evanston, Illinois, 2002.

Download references

Author information

Authors and Affiliations

  1. Zuse Institute Berlin (ZIB), Takustraße 7, 14195, Berlin-Dahlem, Germany

    Artur Andrzejak & Mehmet Ceyran

Authors
  1. Artur Andrzejak
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mehmet Ceyran
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Artur Andrzejak.

Additional information

Artur Andrzejak received the PhD degree in computer science from the Swiss Federal Institute of Technology (ETH Zurich) in 2000. He is currently a researcher at Zuse-Institute Berlin, Germany. He was a postdoctoral researcher at the Hewlett-Packard Labs in Palo Alto, California, from 2001 to 2002. His research interests include systems management and modeling, and Grids.

Mehmet Ceyran is working toward his Masters Degree in Computer Science at the Freie Universität Berlin, Germany. He has been employed as a student programmer at Zuse-Institute Berlin since 2003. His research interests include software engineering, systems management, and artificial intelligence.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Andrzejak, A., Ceyran, M. Characterizing and Predicting Resource Demand by Periodicity Mining. J Netw Syst Manage 13, 175–196 (2005). https://doi.org/10.1007/s10922-005-4440-y

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10922-005-4440-y

Keywords

Search

Navigation