Skip to main content
SpringerLink
Log in

Workflow Scheduling Algorithms for Grid Computing

  • Chapter
Metaheuristics for Scheduling in Distributed Computing Environments

Part of the book series: Studies in Computational Intelligence ((SCI,volume 146))

Summary

Workflow scheduling is one of the key issues in the management of workflow execution. Scheduling is a process that maps and manages execution of inter-dependent tasks on distributed resources. It introduces allocating suitable resources to workflow tasks so that the execution can be completed to satisfy objective functions specified by users. Proper scheduling can have significant impact on the performance of the system. In this chapter, we investigate existing workflow scheduling algorithms developed and deployed by various Grid projects.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Almond, J., Snelling, D.: UNICORE: Uniform Access to Supercomputing as an Element of Electronic Commerce. Future Generation Computer Systems 15, 539–548 (1999)

    Article  Google Scholar 

  2. The Austrian Grid Consortium, http://www.austrangrid.at

  3. Bajaj, R., Agrawal, D.P.: Improving Scheduling of Tasks in a Heterogeneous Environment. IEEE Transactions on Parallel and Distributed Systems 15, 107–118 (2004)

    Article  Google Scholar 

  4. Berman, F., et al.: New Grid Scheduling and Rescheduling Methods in the GrADS Project. International Journal of Parallel Programming (IJPP) 33(2-3), 209–229 (2005)

    Article  Google Scholar 

  5. Berriman, G.B., et al.: Montage: a Grid Enabled Image Mosaic Service for the National Virtual Observatory. In: ADASS XIII, ASP Conference Series (2003)

    Google Scholar 

  6. Berti, G., et al.: Medical Simulation Services via the Grid. In: HealthGRID 2003 conference, Lyon, France, January 16-17 (2003)

    Google Scholar 

  7. Benkner, S., et al.: VGE - A Service-Oriented Grid Environment for On-Demand Supercomputing. In: The 5th IEEE/ACM International Workshop on Grid Computing (Grid 2004), Pittsburgh, PA, USA (November 2004)

    Google Scholar 

  8. Binato, S., et al.: A GRASP for job shop scheduling. In: Essays and surveys on meta-heuristics, pp. 59–79. Kluwer Academic Publishers, Dordrecht (2001)

    Google Scholar 

  9. Blackford, L.S., et al.: ScaLAPACK: a linear algebra library for message-passing computers. In: The Eighth SLAM Conference on Parallel Processing for Scientific Computing (Minneapolis, MN, 1997), Philadelphia, PA, USA, p. 15 (1997)

    Google Scholar 

  10. Blaha, P., et al.: WIEN2k: An Augmented Plane Wave plus Local Orbitals Program for Calculating Crystal Properties. Institute of Physical and Theoretical Chemistry, Vienna University of Technology (2001)

    Google Scholar 

  11. Blythe, J., et al.: Task Scheduling Strategies for Workflow-based Applications in Grids. In: IEEE International Symposium on Cluster Computing and the Grid (CCGrid 2005) (2005)

    Google Scholar 

  12. Braun, T.D., Siegel, H.J., Beck, N.: A Comparison of Eleven static Heuristics for Mapping a Class of Independent Tasks onto Heterogeneous Distributed Computing Systems. Journal of Parallel and Distributed Computing 61, 801–837 (2001)

    Article  Google Scholar 

  13. Buyya, R., Venugopal, S.: The Gridbus Toolkit for Service Oriented Grid and Utility Computing: An overview and Status Report. In: The 1st IEEE International Workshop on Grid Economics and Business Models, GECON 2004, Seoul, Korea, April 23 (2004)

    Google Scholar 

  14. Casanova, H., et al.: Heuristics for Scheduling Parameter Sweep Applications in Grid Environments. In: The 9th Heterogeneous Computing Workshop (HCW 2000) (April 2000)

    Google Scholar 

  15. Cooper, K., et al.: New Grid Scheduling and Rescheduling Methods in the GrADS Project. In: NSF Next Generation Software Workshop, International Parallel and Distributed Processing Symposium, Santa Fe (April 2004)

    Google Scholar 

  16. Doǧan, A., Özgüner, F.: Genetic Algorithm Based Scheduling of Meta-Tasks with Stochastic Execution Times in Heterogeneous Computing Systems. Cluster Computing 7, 177–190 (2004)

    Article  Google Scholar 

  17. Deelman, E., et al.: Pegasus: Mapping scientific workflows onto the grid. In: European Across Grids Conference, pp. 11–20 (2004)

    Google Scholar 

  18. Fahringer, T., et al.: ASKALON: a tool set for cluster and Grid computing. Concurrency and Computation: Practice and Experience 17, 143–169 (2005)

    Article  Google Scholar 

  19. Feo, T.A., Resende, M.G.C.: Greedy Randomized Adaptive Search Procedures. Journal of Global Optimization 6, 109–133 (1995)

    Article  MATH  MathSciNet  Google Scholar 

  20. Fitzgerald, S., et al.: A Directory Service for Configuring High-Performance Distributed Computations. In: The 6th IEEE Symposium on High-Performance Distributed Computing, Portland State University, Portland, Oregon, August 5-8 (1997)

    Google Scholar 

  21. Foster, I., Kesselman, C.: Globus: A Metacomputing Infrastructure Toolkit. International Journal of Supercomputer Applications 11(2), 115–128 (1997)

    Google Scholar 

  22. Foster, I., Kesselman, C. (eds.): The Grid: Blueprint for a Future Computing Infrastructure. Morgan Kaufmann Publishers, USA (1999)

    Google Scholar 

  23. Foster, I., et al.: Chimera: A Virtual Data System for Representing, Querying and Automating Data Derivation. In: The 14th Conference on Scientific and Statistical Database Management, Edinburgh, Scotland (July 2002)

    Google Scholar 

  24. Foster, I., et al.: The Physiology of the Grid, Open Grid Service Infrastructure WG. In: Global Grid Forum (2002)

    Google Scholar 

  25. Goldberg, D.E.: Genetic Algorithms in Search, Optimization, and Machine Learning. Addison-Wesley, Reading (1989)

    MATH  Google Scholar 

  26. Goldberg, D.E., Deb, K.: A comparative analysis of selection schemes used in genetic algorithms. Foundations of Genetic Algorithms, 69–93 (1991)

    Google Scholar 

  27. Grimshaw, A., Wulf, W.: The Legion vision of a worldwide virtual computer. Communications of the ACM 40(1), 39–45 (1997)

    Article  Google Scholar 

  28. He, X., Sun, X., von Laszewski, G.: QoS Guided Min-Min Heuristic for Grid Task Scheduling. Journal of Computer Science and Technology 18(4), 442–451 (2003)

    Article  MATH  Google Scholar 

  29. Hillier, F.S., Lieberman, G.J.: Introduction to Operations Research. McGraw-Hill Science, New York (2005)

    Google Scholar 

  30. Hollinsworth, D.: The Workflow Reference Model, Workflow Management Coalition, TC00-1003 (1994)

    Google Scholar 

  31. Hoos, H.H., Stützle, T.: Stochastic Local Search: Foundation and Applications. Elsevier Science and Technology (2004)

    Google Scholar 

  32. Hou, E.S.H., Ansari, N., Ren, H.: A Genetic Algorithm for Multiprocessor Scheduling. IEEE Transactions on Parallel and Distributed Systems 5(2), 113–120 (1994)

    Article  Google Scholar 

  33. Kwok, Y.K., Ahmad, I.: Static Scheduling Algorithms for Allocating Directed Task Graphs to Multiprocessors. ACM Computing Surveys 31(4), 406–471 (1999)

    Article  Google Scholar 

  34. Ludtke, S., Baldwin, P., Chiu, W.: EMAN: Semiautomated software for high-resolution single-particle reconstructions. Journal of Structural Biology 128, 82–97 (1999)

    Article  Google Scholar 

  35. Mandal, A., et al.: Scheduling Strategies for Mapping Application Workflows onto the Grid. In: IEEE International Symposium on High Performance Distributed Computing (HPDC 2005) (2005)

    Google Scholar 

  36. Mayer, A., et al.: Workflow Expression: Comparison of Spatial and Temporal Approaches. In: Workflow in Grid Systems Workshop, GGF-10, Berlin, March 9 (2004)

    Google Scholar 

  37. Menascè, D.A., Casalicchio, E.: A Framework for Resource Allocation in Grid Computing. In: The 12th Annual International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems (MASCOTS 2004), Volendam, The Netherlands, October 5-7 (2004)

    Google Scholar 

  38. Metropolis, N., et al.: Equations of state calculations by fast computing machines. Joural of Chemistry and Physics 21, 1087–1091 (1953)

    Article  Google Scholar 

  39. Maheswaran, M., et al.: Dynamic Matching and Scheduling of a Class of Independent Tasks onto Heterogeneous Computing Systems. In: The 8th Heterogeneous Computing Workshop (HCW 1999), San Juan, Puerto Rico, April 12 (1999)

    Google Scholar 

  40. O’Brien, A., Newhouse, S., Darlington, J.: Mapping of Scientific Workflow within the e-Protein project to Distributed Resources, UK e-Science All Hands Meeting, Nottingham, UK (2004)

    Google Scholar 

  41. Obitko, M.: Introduction to Genetic Algorithms (March 2006), http://cs.felk.cvut.cz/~xobitko/ga/

  42. Prodan, R., Fahringer, T.: Dynamic Scheduling of Scientific Workflow Applications on the Grid using a Modular Optimisation Tool: A Case Study. In: The 20th Symposium of Applied Computing (SAC 2005), Santa Fe, New Mexico, USA, March 2005. ACM Press, New York (2005)

    Google Scholar 

  43. Rutschmann, P., Theiner, D.: An inverse modelling approach for the estimation of hydrological model parameters. Journal of Hydroinformatics (2005)

    Google Scholar 

  44. Sakellariou, R., Zhao, H.: A Low-Cost Rescheduling Policy for Efficient Mapping of Workflows on Grid Systems. Scientific Programming 12(4), 253–262 (2004)

    Google Scholar 

  45. Sakellariou, R., Zhao, H.: A Hybrid Heuristic for DAG Scheduling on Heterogeneous Systems. In: The 13th Heterogeneous Computing Workshop (HCW 2004), Santa Fe, New, Mexico, USA, April 26 (2004)

    Google Scholar 

  46. Shi, Z., Dongarra, J.J.: Scheduling workflow applications on processors with different capabilities. Future Generation Computer Systems 22, 665–675 (2006)

    Article  Google Scholar 

  47. Spooner, D.P., et al.: Performance-aware Workflow Management for Grid Computing. The Computer Journal (2004)

    Google Scholar 

  48. Sulistio, A., Buyya, R.: A Grid Simulation Infrastructure Supporting Advance Reservation. In: The 16th International Conference on Parallel and Distributed Computing and Systems (PDCS 2004), November 9-11. MIT, Cambridge (2004)

    Google Scholar 

  49. Tannenbaum, T., et al.: Condor - A Distributed Job Scheduler. In: Computing with Linux. MIT Press, Cambridge (2002)

    Google Scholar 

  50. Thickins, G.: Utility Computing: The Next New IT Model. Darwin Magazine (April 2003)

    Google Scholar 

  51. Topcuoglu, H., Hariri, S., Wu, M.Y.: Performance-Effective and Low-Complexity Task Scheduling for Heterogeneous Computing. IEEE Transactions on Parallel and Distributed Systems 13(3), 260–274 (2002)

    Article  Google Scholar 

  52. Tsiakkouri, E., et al.: Scheduling Workflows with Budget Constraints. In: Gorlatch, S., Danelutto, M. (eds.) The CoreGRID Workshop on Integrated research in Grid Computing, Technical Report TR-05-22, University of Pisa, Dipartimento Di Informatica, Pisa, Italy, November 28-30, pp. 347–357 (2005)

    Google Scholar 

  53. Ullman, J.D.: NP-complete Scheduling Problems. Journal of Computer and System Sciences 10, 384–393 (1975)

    Article  MATH  MathSciNet  Google Scholar 

  54. Wang, L., et al.: Task Mapping and Scheduling in Heterogeneous Computing Environments Using a Genetic-Algorithm-Based Approach. Journal of Parallel and Distributed Computing 47, 8–22 (1997)

    Article  Google Scholar 

  55. Wieczorek, M., Prodan, R., Fahringer, T.: Scheduling of Scientific Workflows in the ASKALON Grid Enviornment. ACM SIGMOD Record 34(3), 56–62 (2005)

    Article  Google Scholar 

  56. Wu, A.S., et al.: An Incremental Genetic Algorithm Approach to Multiprocessor Scheduling. IEEE Transactions on Parallel and Distributed Systems 15(9), 824–834 (2004)

    Article  Google Scholar 

  57. YarKhan, A., Dongarra, J.J.: Experiments with Scheduling Using Simulated Annealing in a Grid Environment. In: Parashar, M. (ed.) GRID 2002. LNCS, vol. 2536. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  58. Young, L., et al.: Scheduling Architecture and Algorithms within the ICENI Grid Middleware. In: UK e-Science All Hands Meeting, pp. 5–12. IOP Publishing Ltd., Bristol, UK, Nottingham, UK (2003)

    Google Scholar 

  59. Yu, J., Buyya, R.: A Taxonomy of Workflow Management Systems for Grid Computing. Journal of Grid Computing 3(3-4), 171–200 (2005)

    Article  Google Scholar 

  60. Yu, J., Buyya, R., Tham, C.K.: A Cost-based Scheduling of Scientific Workflow Applications on Utility Grids. In: The first IEEE International Conference on e-Science and Grid Computing, Melbourne, Australia, December 5-8 (2005)

    Google Scholar 

  61. Yu, J., Buyya, R.: Scheduling Scientific Workflow Applications with Deadline and Budget Constraints using Genetic Algorithms. Scientific Programming 14(3-4), 217–230 (2006)

    Google Scholar 

  62. Zhao, H., Sakellariou, R.: An experimental investigation into the rank function of the heterogeneous earliest finish time shceulding algorithm. In: Kosch, H., Böszörményi, L., Hellwagner, H. (eds.) Euro-Par 2003. LNCS, vol. 2790, pp. 189–194. Springer, Heidelberg (2003)

    Google Scholar 

  63. Zhao, Y., et al.: Grid Middleware Services for Virtual Data Discovery, Composition, and Integration. In: The Second Workshop on Middleware for Grid Computing, Toronto, Ontario, Canada (2004)

    Google Scholar 

  64. Zomaya, A.Y., Ward, C., Macey, B.: Genetic Scheduling for Parallel Processor Systems: Comparative Studies and Performance Issues. IEEE Transactions on Parallel and Distributed Systems 10(8), 795–812 (1999)

    Article  Google Scholar 

  65. Zomaya, A.Y., Teh, Y.H.: Observations on Using Genetic Algorithms for Dynamic Load-Balancing. IEEE Transactions on Parallel and Distributed Systems 12(9), 899–911 (2001)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Grid Computing and Distributed Systems (GRIDS) Laboratory Department of Computer Science and Software Engineering, The University of Melbourne, VIC 3010, Austraila

    Jia Yu, Rajkumar Buyya & Kotagiri Ramamohanarao

Authors
  1. Jia Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rajkumar Buyya
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kotagiri Ramamohanarao
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Fatos Xhafa Ajith Abraham

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Yu, J., Buyya, R., Ramamohanarao, K. (2008). Workflow Scheduling Algorithms for Grid Computing. In: Xhafa, F., Abraham, A. (eds) Metaheuristics for Scheduling in Distributed Computing Environments. Studies in Computational Intelligence, vol 146. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-69277-5_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-69277-5_7

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-69260-7

  • Online ISBN: 978-3-540-69277-5

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation