Abstract
Over the last several decades researchers have addressed the use of statistical techniques to estimate the optimal values of difficult optimization problems. These efforts have been developed in different communities with a wide range of different applications in mind. In this paper we review the theory and applications of these approaches and discuss their strengths and weaknesses. We conclude the paper with a discussion of issues to consider when using these methods in computational experiments, and suggest directions for future research.
Similar content being viewed by others
References
Aarts, E., Korst, J.: Simulated Annealing and Boltzmann Machines. Wiley, New York (1989)
Akyuz, M.H., Oncan, T., Altinel, I.K.: The multi-commodity capacitated multi-facility Weber problem: heuristics and confidence intervals. IIE Transactions 42, 825–841 (2010)
Akyuz, M.H., Oncan, T., Altinel, I.K.: Efficient approximate solution methods for the multi-commodity capacitated multi-facility Weber problem. Comput. Oper. Res. 39, 225–237 (2012)
Anagnostopoulos, K.P., Kotsikas, L.: Experimental evaluation of simulated annealing algorithms for the time-cost tradeoff problem. Appl. Math. Comput. 217, 260–270 (2010)
Betro, B., Schoen, F.: Sequential stopping rules for the multistart algorithm in global optimization. Math. Program. 38, 271–286 (1987)
Bettinger, P., Boston, K., Kim, Y.H., Zhu, J.: Landscape-level optimization using tabu search and stand density-related forest management prescriptions. Eur. J. Oper. Res. 176, 1265–1282 (2007)
Boender, C.G.E., Rinnooy Kan, A.H.G.: A Bayesian analysis of the number of cells of a multinomial distribution. Statistician 32, 240–248 (1983)
Boender, C.G.E., Rinnooy Kan, A.H.G.: Bayesian stopping rules for multistart global optimization methods. Math. Program. 37, 59–80 (1987)
Boender, C.G.E., Rinnooy Kan, A.H.G., Stougie, L., Timmer, G.T.: A stochastic method for global optimization. Math. Program. 22, 125–140 (1982)
Brandeau, M.L., Chiu, S.S.: Sequential location and allocation: worst case performance and statistical estimation. Locat. Sci. 1(4), 289–298 (1993)
Bruijs, P.A.: On the quality of solutions to a 19x19 quadratic assignment problem. Eur. J. Oper. Res. 17, 21–30 (1984)
Clough, D.J.: An asymptotic extreme-value sampling theory for estimation of a global maximum. Can. Oper. Res. Soc. 7, 102–115 (1969)
Coles, S.G., Powell, E.A.: Bayesian methods in extreme value modelling: a review and new developments. Int. Stat. Rev. 64, 119–136 (1996)
Cooke, P.: Statistical inference for bounds of random variables. Biometrika 66(2), 367–374 (1979)
Dannenbring, D.: Estimating optimal solutions for large combinatorial problems. Manag. Sci. 23, 1273–1283 (1977)
Derigs, U.: Using confidence limits for the global optimal in combinatorial optimization. Oper. Res. 33, 1024–1049 (1985)
Fisher, R.A., Tippett, L.: Limiting forms of the frequency distribution of the largest or smallest member of a sample. Proc. Camb. Philos. Soc. 24, 180–190 (1928)
Ganesan, V.K., Sivakumar, A.I.: Scheduling in static jobshops for minimizing mean flowtime subject to minimum total deviation of job completion times. Int. J. Prod. Econ. 103, 633–647 (2006)
Garey, M.R., Johnson, D.S.: Computers and Intractability: a Guide to the Theory of NP Completeness. W. H. Freeman, San Francisco (1979)
Ghashghai, E., Rardin, R.L.: Using a hybrid of exact and genetic algorithms to design survivable networks. Comput. Oper. Res. 29, 53–66 (2002)
Giddings, A.P.: A unified approach to statistical quality assessment in heuristic combinatorial optimization. Ph.D. Thesis, School of Industrial Engineering, Purdue University, West Lafayette (2002)
Glover, F., Laguna, M.: Tabu Search. Kluwer Academic, Norwell (1997)
Gokhale, R., Mathirajan, M.: Scheduling identical parallel machines with machine eligibility restrictions to minimize total weighted flow time in automobile gear manufacturing. Int. J. Adv. Manuf. Technol. 60, 1099–1110 (2012)
Goldberg, D.E.: Genetic Algorithms in Search, Optimization, and Machine Learning. Addison-Wesley, Boston (1989)
Golden, B.L.: Point estimation of a global optimum for large combinatorial problems. Commun. Stat. 7(4), 361–367 (1978)
Golden, B.L., Alt, F.B.: Interval estimation of a global optimum for large combinatorial problems. Nav. Res. Log. Quart. 26, 69–77 (1979)
Gourdin, E., Hansen, P., Jaumard, B.: Finding maximum likelihood estimators for the three-parameter Weibull distribution. J. Glob. Optim. 5, 373–397 (1994)
Gumbel, E.J.: Statistics of Extremes. Columbia University Press, New York (1958)
Hall, N.G., Ghosh, S., Kankey, R.D., Narasimhan, S., Rhee, W.T.: Bin packing problems in one dimension: heuristic solutions and confidence intervals. Comput. Oper. Res. 15(2), 171–177 (1988)
Hartley, H.O., Pfaffenberger, R.C.: Quadratic forms in order statistics used as goodness of fit criteria. Biometrika 59(3), 605–611 (1972)
Hirose, H.: Maximum likelihood estimation in the 3-parameter Weibull distribution: a look through the generalized extreme-value distribution. IEEE Trans. Dielectr. Electr. Insul. 3(1), 43–55 (1996)
Huntley, C.L., Brown, D.E.: Parallel genetic algorithms with local search. Comput. Oper. Res. 23(6), 559–571 (1996)
Kudva, G., Elkamel, A., Pekny, J., Reklaitis, G.V.: Heuristic scheduling algorithm for scheduling batch and semi-continuous plants with production deadlines, intermediate storage requirements and equipment changeover costs. Comput. Chem. Eng. 18(9), 859–875 (1994)
Lawler, E.L., Lenstra, J.K., Rinnooy Kan, A.H.G., Shmoys, D.B. (eds.): The Traveling Salesman Problem: A Guided Tour of Combinatorial Optimization. Wiley, Chichester (1985)
Los, M., Lardinois, C.: Combinatorial programming, statistical optimization and the optimal transportation network problem. Transp. Res. 16B, 89–124 (1982)
Maffioli, F.: Randomized algorithms in combinatorial optimization: a survey. Discret. Appl. Math. 14, 157–170 (1986)
Marin, A., Salmeron, J.: Tactical design of rail freight networks part II: local search methods and statistical analysis. Eur. J. Oper. Res. 94, 43–53 (1996)
Mathirajan, M., Chandru, V., Sivakumar, A.I.: Heuristic algorithms for scheduling heat-treatment furnaces of steel casting industries. Sadhana Acad. Proc. Eng. Sci. 32(5), 479–500 (2007)
McRoberts, K.L.: A search model for evaluating combinatorially explosive problems. Oper. Res. 19, 1331–1349 (1971)
Monroe, H.M., Sielken, R.L.: Confidence limits for global optima based on heuristic solutions to difficult optimization problems: a simulation study. Am. J. Math. Manag. Sci. 4(1–2), 139–167 (1984)
Nydick, R.L., Weiss, H.J.: A computational evaluation of optimal solution estimation techniques. Comput. Oper. Res. 15(5), 427–440 (1988)
Nydick, R.L., Weiss, H.J.: An analytical evaluation of optimal solution value estimation procedures. Nav. Res. Logist. 41, 189–202 (1994)
O’Hara, A.J., Faaland, B.H., Bare, B.B.: Spatially constrained timber harvest scheduling. Can. J. For. Res. 19, 715–724 (1989)
Ovacik, I.M., Rajagopalan, S., Uzsoy, R.: Integrating interval estimates of global optima and local search methods for combinatorial optimization problems. J. Heuristics 6, 481–500 (2000)
Papadimitriou, C.H., Steiglitz, K.: Some examples of difficult traveling salesman problems. Oper. Res. 26(3), 434–443 (1978)
Patel, N.R., Smith, R.L.: The asymptotic extreme value distribution of the sample minimum of a concave function under linear constraints. Oper. Res. 31, 789–794 (1983)
Paya-Zaforteza, I., Yepes, V., Gonzalez-Vidosa, F., Hospitaler, A.: On the Weibull cost estimation of building frames designed by simulated annealing. Meccanica 45, 693–704 (2010)
Quenouille, M.H.: Notes on bias in estimation. Biometrika 43(3/4), 353–360 (1956)
Reeves, C.R., Eremeev, A.V.: Statistical analysis of local search landscapes. J. Oper. Res. Soc. 55, 687–693 (2004)
Reiter, S., Sherman, G.: Discrete optimizing. J. Soc. Ind. Appl. Math. 13, 864–889 (1965)
Robson, D.S., Whitlock, J.H.: Estimation of a truncation point. Biometrika 51, 33–39 (1964)
Sastry, S., Pi, J.I.: Estimating the minimum of partitioning and floorplanning problems. IEEE Trans. Comput. Aided Des. 10(2), 273–282 (1991)
Sivrikaya-Serifoglu, F., Ulusoy, G.: Multiprocessor task scheduling in hybrid flow-shops: a genetic algorithm approach. J. Oper. Res. Soc. 55, 504–512 (2004)
van der Watt, P.: A note on estimation of bounds of random variables. Biometrika 67, 712–714 (1980)
Vasko, F.J., Wilson, G.R.: An efficient heuristic for large set covering problems. Nav. Res. Logist. Q. 31, 163–171 (1984)
Wang, Q., Stengel, R.F.: Searching for robust minimal-order compensators. J. Dyn. Syst. Meas. Control 123, 233–238 (2001)
Wilson, A.D., King, R.E., Wilson, J.R.: Case study on statistically estimating minimum makespan for flow line scheduling problems. Eur. J. Oper. Res. 155, 439–454 (2004)
Yeo, I.Y., Guldmann, J.M.: Global spatial optimization with hydrological systems simulation: application to land-use allocation and peak runoff minimization. Hydrol. Earth Syst. Sci. 14, 325–338 (2010)
Zanakis, S.H.: A simulation study of some simple estimators of the three-parameter Weibull distribution. J. Stat. Comput. Simul. 9, 419–428 (1979)
Zanakis, S.H., Kyparisis, J.: A review of maximum likelihood estimation methods for the three-parameter Weibull distribution. J. Stat. Comput. Simul. 25(1–2), 53–73 (1986)
Zanakis, S.H., Mann, N.R.: A good simple percentile estimator of the Weibull shape parameter for use when all three parameters are unknown. Nav. Res. Logist. Q. 29(3), 419–428 (1982)
Acknowledgments
The authors would like to thank Professor Bruce W. Schmeiser of the School of Industrial Engineering, Purdue University, for his contributions to this paper, notably the graphical comparisons presented in Sect. 6 and the PH model presented in Sect. 10, as well as numerous other suggestions throughout the course of the work.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Giddings, A.P., Rardin, R.L. & Uzsoy, R. Statistical optimum estimation techniques for combinatorial optimization problems: a review and critique. J Heuristics 20, 329–358 (2014). https://doi.org/10.1007/s10732-014-9243-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10732-014-9243-4