Skip to main content
Log in

A Progressive Hedging based branch-and-bound algorithm for mixed-integer stochastic programs

  • Original Paper
  • Published:
Computational Management Science Aims and scope Submit manuscript

Abstract

Progressive Hedging (PH) is a well-known algorithm for solving multi-stage stochastic convex optimization problems. Most previous extensions of PH for mixed-integer stochastic programs have been implemented without convergence guarantees. In this paper, we present a new framework that shows how PH can be utilized while guaranteeing convergence to globally optimal solutions of mixed-integer stochastic convex programs. We demonstrate the effectiveness of the proposed framework through computational experiments.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Notes

  1. An alternative statement of the problem is given in Rockafellar and Wets (1991). The authors pose the problem as a projected saddle function that is extended with proximal terms on the \(\hat{X}\) and \(\Lambda \) variables. The proof of convergence for the PH algorithm relies on this interpretation.

  2. The authors use a 96-core Intel Xeon workstation with 2.1 GHz processors and 1 TB of RAM, where 50 instances of the PH algorithm are executed in parallel, and each instance is allowed to use up to 2 cores.

References

  • Ahmed S (2013) A scenario decomposition algorithm for 0–1 stochastic programs. Oper Res Lett 41(6):565–569

    Article  Google Scholar 

  • Ahmed S, Garcia R, Kong N, Ntaimo L, Parija G, Qiu F, Sen S (2015) SIPLIB: a stochastic integer programming test problem library. http://www.isye.gatech.edu/~sahmed/siplib. Accessed 5 July 2017

  • Angulo G, Ahmed S, Dey SS (2014) Improving the integer L-shaped method. Technical report, School of Industrial and Systems Engineering, Georgia Institute of Technology

  • Barnett J, Watson J-P, Woodruff DL (2017) BBPH: using Progressive Hedging within branch and bound to solve multi-stage stochastic mixed integer programs. Oper Res Lett 45(1):34–39

    Article  Google Scholar 

  • Birge JR (1985) Decomposition and partitioning methods for multistage stochastic linear programs. Oper Res 33(5):989–1007

    Article  Google Scholar 

  • Bixby RE (2002) Solving real-world linear programs: a decade and more of progress. Oper Res 50(1):3–15

    Article  Google Scholar 

  • Boland N, Christiansen J, Dandurand B, Eberhard A, Linderoth J, Luedtke J, Oliveira F (2016) Combining Progressive Hedging with a Frank–Wolfe method to compute Lagrangian dual bounds in stochastic mixed-integer programming. Technical report, Optimization Online

  • Boland NL, Eberhard AC (2014) On the augmented Lagrangian dual for integer programming. Math Program 150(2):491–509

    Article  Google Scholar 

  • Boyd S (2010) Distributed optimization and statistical learning via the alternating direction method of multipliers. Found Trends Mach Learn 3(1):1–122

    Article  Google Scholar 

  • Carøe CC, Schultz R (1999) Dual decomposition in stochastic integer programming. Oper Res Lett 24(1–2):37–45

    Article  Google Scholar 

  • Carøe CC, Tind J (1998) L-shaped decomposition of two-stage stochastic programs with integer recourse. Math Program 83:451–464

    Article  Google Scholar 

  • Escudero LF, Garín A, Merino M, Pérez G (2009) BFC-MSMIP: an exact branch-and-fix coordination approach for solving multistage stochastic mixed 0–1 problems. Top 17:96–122

    Article  Google Scholar 

  • Feizollahi MJ, Ahmed S, Sun A (2015) Exact augmented Lagrangian duality for mixed integer linear programming. Technical report, School of Industrial and Systems Engineering, Georgia Institute of Technology

  • Gade D, Hackebeil G, Ryan SM, Roger J-PW, David JW (2016) Obtaining lower bounds from the Progressive Hedging algorithm for stochastic mixed-integer programs. Math Program 157(1):47–67

    Article  Google Scholar 

  • Gade D, Küçükyavuz S, Sen S (2014) Decomposition algorithms with parametric Gomory cuts for two-stage stochastic integer programs. Math Program 144(1–2):39–64

    Article  Google Scholar 

  • Guignard M, Kim S (1987) Lagrangean decomposition: a model yielding stronger Lagrangean bounds. Math Program 39(2):215–228

    Article  Google Scholar 

  • Guo G, Hackebeil G, Ryan SM, Watson J-P, Woodruff DL (2015) Integration of Progressive Hedging and dual decomposition in stochastic integer programs. Oper Res Lett 43(3):311–316

    Article  Google Scholar 

  • Helmberg C (2000) Semidefinite programming for combinatorial optimization. Konrad-Zuse-Zentrum für Informationstechnik, Berlin

    Google Scholar 

  • Hemmecke R, Schultz R (2003) Decomposition of test sets in stochastic integer programming. Math Program 94(2–3):323–341

    Article  Google Scholar 

  • Higle JL, Sen S (2006) Multistage stochastic convex programs: duality and its implications. Ann Oper Res 142(1):129–146

    Article  Google Scholar 

  • Horst R, Tuy H (2013) Global optimization: deterministic approaches. Springer, Berlin

    Google Scholar 

  • Jörnsten K, Näsberg M, Smeds P (1985) Variable splitting: a new Lagrangean relaxation approach to some mathematical programming models. Technical report, Department of Mathematics, University of Linköping

  • Laporte G, Louveaux FV (1993) The integer L-shaped method for stochastic integer programs with complete recourse. Oper Res Lett 13(3):133–142

    Article  Google Scholar 

  • Løkketangen A, Woodruff DL (1996) Progressive Hedging and tabu search applied to mixed integer (0, 1) multistage stochastic programming. J Heuristics 2(2):111–128

    Article  Google Scholar 

  • Louveaux FV (1980) A solution method for multistage stochastic programs with recourse with application to an energy investment problem. Oper Res 28(4):889–902

    Article  Google Scholar 

  • Lubin M, Martin K, Petra CG, Sandıkçı B (2013) On parallelizing dual decomposition in stochastic integer programming. Oper Res Lett 41(3):252–258

    Article  Google Scholar 

  • Lulli G, Sen S (2004) A branch-and-price algorithm for multistage stochastic integer programming with application to stochastic batch-sizing problems. Manag Sci 50(6):786–796

    Article  Google Scholar 

  • Mulvey JM, Vladimirou H (1991) Applying the Progressive Hedging algorithm to stochastic generalized networks. Ann Oper Res 31(1):399–424

    Article  Google Scholar 

  • Mulvey JR, Ruszczyński A (1995) A new scenario decomposition method for large-scale stochastic optimization. Oper Res 43(3):477–490

    Article  Google Scholar 

  • Ntaimo L, Sen S (2005) The million-variable “march” for stochastic combinatorial optimization. J Global Optim 32(3):385–400

    Article  Google Scholar 

  • Pages-Bernausa A, Pérez-Valdés G, Tomasgard A (2015) A parallelised distributed implementation of a branch and fix coordination algorithm. Eur J Oper Res 244:77–85

    Article  Google Scholar 

  • Qi Y, Sen S (2016) The ancestral Benders’ cutting plane algorithm with multi-term disjunctions for mixed-integer recourse decisions in stochastic programming. Math Program 161:193–235

    Article  Google Scholar 

  • Ralphs T, Hassanzadeh A (2014) A generalization of Benders’ algorithm for two-stage stochastic optimization problems with mixed integer recourse. Technical report, Laboratory for Computational Optimization at Lehigh (COR@L), Department of Industrial and Systems Engineering, Lehigh University

  • Rockafellar RT (1976) Monotone operators and the proximal point algorithm. SIAM J Control Optim 14(5):877–898

    Article  Google Scholar 

  • Rockafellar RT, Wets RJ-B (1991) Scenarios and policy aggregation in optimization under uncertainty. Math Oper Res 16(1):119–147

    Article  Google Scholar 

  • Ruszczyński A (2002) Probabilistic programming with discrete distributions and precedence constrained knapsack polyhedra. Math Program 93:195–215

    Article  Google Scholar 

  • Ryan K, Ahmed S, Dey SS, Rajan D (2016) Optimization driven scenario grouping. Technical report, School of Industrial and Systems Engineering, Georgia Institute of Technology

  • Ryan SM, Wets RJB, Woodruff DL, Silva-Monroy C, Watson JP (2013) Toward scalable, parallel Progressive Hedging for stochastic unit commitment. In: Power and energy society general meeting (PES), 2013 IEEE, pp 1–5

  • Sen S, Higle JL (2005) The C3 theorem and a D2 algorithm for large scale stochastic mixed-integer programming: set convexification. Math Program 104(1):1–20

    Article  Google Scholar 

  • Sen S, Sherali HD (2006) Decomposition with branch-and-cut approaches for two-stage stochastic mixed-integer programming. Math Program 106(2):203–223

    Article  Google Scholar 

  • Trapp AC, Prokopyev OA, Schaefer AJ (2013) On a level-set characterization of the value function of an integer program and its application to stochastic programming. Oper Res 61(2):498–511

    Article  Google Scholar 

  • Van Slyke RM, Wets R (1969) L-shaped linear programs with applications to optimal control and stochastic programming. SIAM J Appl Math 17(4):638–663

    Article  Google Scholar 

  • Watson J-P, Woodruff DL (2010) Progressive hedging innovations for a class of stochastic mixed-integer resource allocation problems. CMS 8(4):355–370

    Article  Google Scholar 

  • Zhang M, Küçükyavuz S (2014) Finitely convergent decomposition algorithms for two-stage stochastic pure integer programs. SIAM J Optim 24(4):1933–1951

    Article  Google Scholar 

Download references

Acknowledgements

This paper is written in honor of Professor Maarten van der Vlerk. His invention took a very elegant approach to a very difficult problem: stochastic programs with simple integer recourse (SIR). Maarten’s research inspired the authors to study a problem that he referred to as Mixed-Integer Stochastic Programming (MISP), emphasizing the SP side of the problem. The approach of our paper (PH-BAB), while very different from algorithms for SIR problems, reflects Maarten’s MISP point of view: the mixed-integer aspects of our algorithm work within an essentially SP algorithm, the PH method. In this sense, the work in this paper adopts Maarten’s view (MISP), although most of the second author’s other work may be looked upon as Stochastic Mixed-Integer Programming (SMIP). For some, this distinction may not mean much, but we believe that the difference meant something to Maarten. We wish to honor his vision with this paper.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Suvrajeet Sen.

Additional information

This research was funded by the NSF Grant ECCS 1548847 and AFOSR Grant FA9550-15-1-0267.

Appendix A: SSLP formulation

Appendix A: SSLP formulation

We provide the formulation of the stochastic server location problems (SSLPs) of Ntaimo and Sen (2005), which we use in Sect. 5. The problem considers a set of locations \(\mathcal {J}\), zones \(\mathcal {Z}\), and clients \(\mathcal {I}\). The goal is to obtain (i) a cost-efficient allocation of servers into locations specified in \(\mathcal {J}\), and (ii) a cost-efficient assignment of clients to these servers under random client availability. We list the decision variables of the problem below.

\(z_j\)::

1 if server is located at site j, 0 otherwise

\(y_{ij}^s\)::

1 if client i is served by server at location j under scenario s, 0 otherwise

\(y_{j0}^s\)::

amount of demand overflow due to server capacity limitations.

The variable \(y_{j0}^s\) must not take large values, therefore is penalized using the penalty function \(\phi _j^s\). Each problem instance takes the following input parameters:

\(c_j\)::

cost of locating a server at location \(j \in \mathcal {J}\)

\(q_{ij}\)::

revenue from client \(i \in \mathcal {I}\) when served by server at location j

\(d_{ij}\)::

demand of client i from server at location j

u::

server capacity

v::

upper bound on the total number of located servers

\(w_z\)::

minimum number of servers to be located in zone \(z \in \mathcal {Z}\)

\(\mathcal {J}_z\)::

subset of server locations that belong to zone z

\(\gamma _i\)::

random availability of client i

\(\gamma _i^s\)::

realization of \(\gamma _i\) under scenario s (1 if client i is present in scenario s, 0 otherwise).

The first- and the second-stage subproblems are respectively given below.

$$\begin{aligned} \min ~&\sum _{j \in \mathcal {J}} c_j z_j + \mathbb {E}\left[ h(z, \gamma )\right] \nonumber \\ \text {s.t.} \quad ~&\sum _{j \in \mathcal {J}} z_j \le v \end{aligned}$$
(13a)
$$\begin{aligned}&\sum _{j \in \mathcal {J}_z} z_{j} \ge w_z, \quad \forall z \in \mathcal {Z} \nonumber \\&z_j \in \mathbb {B}, \quad \forall z \in \mathcal {Z}, \end{aligned}$$
(13b)
$$\begin{aligned} h(z, \gamma ^s) = \min ~&- \left( \sum _{i \in \mathcal {I}} \sum _{j \in \mathcal {J}} q_{ij}^s y_{ij}^s - \sum _{j \in \mathcal {J}} \phi _j^s\left( y_{j0}^s\right) \right) \nonumber \\ \text {s.t.} \quad ~&\sum _{i \in \mathcal {I}} d_{ij} y_{ij}^s - y^s_{j0} \le u z_j, \quad \forall i \in \mathcal {I}, \quad j \in \mathcal {J} \end{aligned}$$
(13c)
$$\begin{aligned}&\sum _{j \in \mathcal {J}} y_{ij}^s = \gamma _i^s, ~ \forall i \in \mathcal {I} \nonumber \\&y^s_{ij} \in \mathbb {B}, ~ \forall i \in \mathcal {I}, \quad j \in \mathcal {J} \nonumber \\&y^s_{j0} \ge 0, \quad \forall j \in \mathcal {J}. \end{aligned}$$
(13d)

Constraints (13a) limit the maximum number of server allocations; (13b) ensures each zone receives the minimum number of required servers; (13c) models the server capacity restrictions; (13d) ensures that each client is served by a single server.

In the original SSLP instances of Ntaimo and Sen (2005), the penalty function is assumed to have a linear form \(\phi _j^s (y_{j0}^s) = q_{j0}^s y_{j0}^s\), where \(q_{j0}^s\) is a large coefficient. The quadratic extension of the problem upgrades this penalty function as \(\phi _j^s( y_{j0}^s ) = q_{j0}^s \big ( y_{j0}^s \big )^2\). In order to increase the significance of the new quadratic penalty function, the server capacity parameter u is adjusted to be smaller in the new instances.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Atakan, S., Sen, S. A Progressive Hedging based branch-and-bound algorithm for mixed-integer stochastic programs. Comput Manag Sci 15, 501–540 (2018). https://doi.org/10.1007/s10287-018-0311-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10287-018-0311-3

Keywords

Navigation