Abstract
In this paper, a multiobjective dynamic bin packing problem for storing cooling objects is introduced along with a metaheuristic designed to work well in mixed-variable environments. The dynamic bin packing problem is based on cookie production at a bakery, where cookies arrive in batches at a cooling rack with limited capacity and are packed into boxes with three competing goals. The first is to minimize the number of boxes used. The second objective is to minimize the average initial heat of each box, and the third is to minimize the maximum time until the boxes can be moved to the storefront. The metaheuristic developed here incorporated greedy heuristics into an adaptive evolutionary framework with partial decomposition into clusters of solutions for the crossover operator. The new metaheuristic was applied to a variety benchmark bin packing problems and to a small and large version of the dynamic bin packing problem. It performed as well as other metaheuristics in the benchmark problems and produced more diverse solutions in the dynamic problems. It performed better overall in the small dynamic problem, but its performance could not be proven to be better or worse in the large dynamic problem.
Similar content being viewed by others
References
Abdi, H.: Encyclopedia of Measurements and Statistics, Thousand Oaks, CA, Chapter, The Bonferroni and Sidak Corrections for Multiple Procedures (2007)
Adra, S.F., Flemin, P.J.: Diversity management in evolutionary many-objective optimization. IEEE Trans. Evol. Comput. 15(2), 183–195 (2011). https://doi.org/10.1109/TEVC.2010.2058117
Anily, S., Bramel, J., Simchi-Levi, D.: Worst-case analysis of heuristics for the bin packing problem with general cost structures. Oper. Res. 42(2), 287–298 (1994)
Butenko, S., Pardalos, P.M.: Numerical Methods and Optimization: An Introduction. CRC Press, Boca Raton (2014)
Cao, Y.J., Jiang, L., Wu, Q.H.: An evolutionary programming approach to mixed-variable optimization problems. Appl. Math. Model. 24, 931–942 (2000)
Cengel, Y.A.: Heat Transfer: A Practical Approach, 2nd edn. Mcgraw-Hill, New York (2002). ISBN-10: 0072458933
Chwatal, A.M., Pirkwieser, S.: Solving the two-dimensional bin-packing problem with variable bin sizes by greedy randomized adaptive search procedures and variable neighborhood search. In: International Conference on Computer Aided Systems Theory, pp. 456–463 (2011)
Dahmani, N., Clautiaux, F., Krichen, S., Talbi, E.G.: Self-adaptive metaheuristics for solving a multi-objective 2-dimensional vector packing problem. Appl. Soft Comput. 16, 124–136 (2014)
Dartey, C.K., Finley, J.W., Thulin, R.R.: Process for Preparing Chocolate Chip Cookies Containing Low Melting Fat and Product. U.S. Patent No. 4,722,849, Issued Date February 2 (1988)
Deb, K., Pratap, A., Agarwal, S., Meyarivan, T.: A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans. Evol. Comput. 6(2), 182–197 (2002)
Feo, T.A., Resende, M.G.: Greedy randomized adaptive search procedures. J. Global Optim. 6, 109–133 (1995)
Fonseca, C.M., Knowles, J.D., Thiele, L., Zitzler, E.: A tutorial on the performance assessment of stochastic multiobjective optimizers. In: Evolutionary Multi-Criterion Optimization: First International Conference, EMO 2005, Guanajauto, Mexico (2005)
Fonseca, C.M., Guerreiro, A.P., López-Ibáñez, M., Paquete, L.: On the computation of the empirical attainment function. In: Takahashi, R.H., Deb, K., Wanner, E.F., Greco, S. (eds.) Evolutionary Multi-Criterion Optimization: 6th International Conference, EMO 2011, Ouro Preto, Brazil, April 5–8, 2011. Proceedings, pp. 106–120. Springer, Berlin (2011)
Goh, C.K., Tan, K.C., Liu, D.S., Chiam, S.: A competitive and cooperative co-evolutionary approach to multi-objective particle swarm optimization algorithm design. Eur. J. Oper. Res. 202, 42–54 (2010)
Grunert da Fonseca, V., Fonseca, C.M., Hall, A.O.: Inferential performance assessment of stochastic optimisers and the attainment function. In: Zitzler, E., Thiele, L., Deb, K., Coello Coello, C.A. (eds.) Evolutionary Multi-Criterion Optimization: First International Conference, EMO 2001, Zurich, Switzerland, March 7–9, 2001. Proceedings, pp. 213–225. Springer, Berlin (2001)
Hunter, J.: Matplotlib: a 2D graphics environment. Comput. Sci. Eng. 9(3), 90–95 (2007)
Ishibuchi, H., Hitotsuyanagi, Y., Tsukamoto, N., Nojima, Y.: Implementation of multiobjective memetic algorithms for combinatorial optimization problems: a knapsack problem case study. Stud. Comput. Intell. 171, 27–49 (2009)
Ke, L., Zhang, Q., Battiti, R.: Hybridization of decomposition and local search for multiobjective optimization. IEEE Tran. Cybern. 44(10), 1808–1820 (2014)
Kulacki, F.A., Kennedy, S.C.: Measurement of the thermophysical properties of common cookie cough. J. Food Sci. 43, 380–384 (1978)
Lara, O.D., Labrador, M.A.: A multiobjective ant colony-based optimization algorithm for the bin packing problem with load balancing. In: 2010 IEEE Congress on Evolutionary Computation (CEC), pp. 1–8. IEEE (2010)
Lee, K.D., Hubbard, S.: Data Structures and Algorithms with Python. Undergraduate Topics in Computer Science, Springer International Publishing Switzerland (2015)
Li, Y., Tang, X., Cai, W.: Dyanmic bin packing for on-demand cloud resource allocation. IEEE Trans. Parallel Distrib. Syst. 27(1), 157–170 (2016)
Liu, D.S., Tan, K.C., Huang, S.Y., Goh, C.K., Ho, W.K.: On solving multiobjective bin packing problems using evolutionary particle swarm optimization. Eur. J. Oper. Res. 190(2), 357–382 (2008)
Martello, S., Toth, P.: Knapsack Problems: Algorithms and Computer Implementations. Wiley, New York, Chapter 8. Bin-packing problem, pp. 221–245 (1990)
Nicoarǎ, E.S.: Performance measures for multi-objective optimization algorithms. Buletinul Universitǎţii Petrol–Gaze din Ploieşti, Seria Matematicǎ-Informaticǎ-Fizicǎ 59(1), 19–28 (2007)
Nitin, N., Karwe, M.V.: Heat transfer coefficient for model cookies in a turbulent multiple jet impingement system. In: Welti-Chanes, J., Velez-Ruiz, J.F., Barbosa-Cánovas, G.V. (eds.) Transport Phenomena in Food Processing, pp. 357–376. CRC Press, Boca Raton (2002)
Ochoa, G., Walker, J., Hyde, M., Curtois, T.: Adaptive evolutionary algorithms and extensions to the hyflex hyper-heuristic framework. In: Coello, C.A.C., Cutello, V., Deb, K., Forrest, S., Nicosia, G., Pavone, M. (eds.) Parallel Problem Solving from Nature—PPSN XII: 12th International Conference, Taormina, Italy, September 1–5, 2012, Proceedings, Part II, Springer, Berlin, pp. 418–427 (2012)
Sathe, M., Schenk, O., Burkhart, H.: Solving Bi-objective Many-Constraint Bin Packing Problems in Automobile Sheet Metal Forming Processes, pp. 246–260. Springer, Berlin (2009)
Satterthwaite, F.: An approximate distribution of estimates of variance components. Biom. Bull. 2(6), 110–114 (1946)
Silva, E., Oliveira, J.F., Wäscher, G.: 2DCPackGen: a problem generator for two-dimensional rectangular cutting and packing problems. Eur. J. Oper. Res. 237, 846–856 (2014)
Zhang, Q., Liu, W., Tsang, E., Virginas, B.: Expensive multiobjective optimization by MOEA/D with gaussian process model. IEEE Trans. Evol. Comput. 14(3), 456–473 (2010)
Zhou, A., Qu, B.Y., Li, H., Zhao, S.Z., Suganthan, P.N., Zhang, Q.: Multiobjective evolutionary algorithms: a survey of the state of the art. Swarm Evolut. Comput. 1(1), 32–49 (2011)
Zitzler, E., Thiele, L.: Parallel Problem Solving from Nature (PPSN V), Springer, Berlin, Germany, Book Section Multiobjective Optimization Using Evolutionary Algorithms—A Comparative Case Study, pp. 292–301 (1998)
Zitzler, E., Thiele, L., Laumanns, M., Fonseca, C.M., Fonseca, VGd: Performance assessment of multiobjective optimizers: an analysis and review. IEEE Trans. Evol. Comput. 7(2), 117–132 (2003)
Acknowledgements
We would like to thank Sergiy Butenko for his valuable feedback during development of GAMMA-PC. The graphs in this paper were created using Matplotlib (Hunter 2007).
Author information
Authors and Affiliations
Corresponding author
Additional information
The results discussed in this paper are available as a Zenodo dataset. https://doi.org/10.5281/zenodo.1302398.
Research supported by the US Department of Energy, Office of Nuclear Energy, under Contract Number DE-AC05-00OR22725 (Jarrell), Texas A&M University (Tsvetkov), and by the ORNL GO! Fellowship Program (Spencer).
Appendix
Appendix
In (Fonseca et al. 2005), the authors advocate the use of the Kruskal-Wallis test to evaluate unary quality indicators with three or more independent samples. The unary indicators investigated here are the maximum spread indicators, the Pareto front absolute effiency, and the distance measures. Therefore, the Kruskal-Wallis test was applied to the samples to determine the presence of a signifcant difference before applying the student-t difference tests. The degrees of freedom for the student-t tests were found using the Satterthwaite approximation given in (39) (Satterthwaite 1946).
The statistical relevance of binary indicators are determined by two tests in this work. The Wilcoxon-rank sum test is performed first to determine if the samples in the comparison belong to the same distribution. If they are determined to be different, the student-t difference test is then performed to determine if the difference meets the conditions of the comparison operator, assuming similar standard deviations.
Applying this procedure to the binary coverage indicator, the Wilcoxon-rank sum test is used to prove either the null hypothesis and the alternative hypothesis shown in (40).
Then, if \(H_{wr,1}\) is accepted, the student-t test is applied to determine if the difference between the samples corresponds to the null hypothesis, corresponding to the conditions for better performance, or to the alternative hypothesis shown in (41).
Applying this procedure to the binary-\(\varepsilon \) indicator, the Wilcoxon-rank sum test is used to prove either the null hypothesis and the alternative hypothesis shown in (42).
Then, if \(H_{wr,1}\) is accepted, the student-t test is applied to determine if the difference between the samples corresponds to the null hypothesis, corresponding to the conditions for better performance, or to the alternative hypothesis shown in (43).
Table 5 presents the statistical analysis of Fig. 5, using an overall Type-I error rate of 0.05% and Bonferroni’s Method (Abdi 2007) to evaluate if each comparison meets the necessary condition of \((I_C(A,B) = 1 \cap I_C(B, A) < 1)\). Table 5 shows that while the \(I_C\) values for GAMMA-PC were proven to be significantly different than the values for MOMAD and MOEPSO, GAMMA-PC’s performance cannot be proven to be significantly better (or worse) than NSGA-II, MOMA, MOMAD, or MOEPSO by the binary coverage indicator.
Table 6 presents the statistical analysis of Fig. 6, using an overall Type I error rate of 0.05% and Bonferroni’s Method to evaluate if each binary comparison meets the condition of \((I_\varepsilon (A, B) \le 1 \cap I_\varepsilon (B, A) > 1)\). With this metric, GAMMA-PC is proven to perform better than NSGA-II, MOMAD, and MOEPSO but not MOMA.
Table 7 presents the statistical evaluation of the maximum spread indicator for the static problem. The Kruskal-Wallis test showed that there were statistically signficant differences in the maximum spread indicators for GAMMA-PC, NSGA-II, MOMA, MOMAD, and MOEPSO (\(\chi ^2(2)= 83.3\), \(p< 0.00001\)). Based on this evidence, student-t tests were applied to the differences in the spread values between GAMMA-PC and the others. The alternative hypothesis was accepted for each test, indicating that GAMMA-PC produces more diverse solutions at a statistically significant level.
Table 8 presents the statistical evaluation of the box plots shown in Figs. 11 and 12. The Kruskal-Wallis test showed that there were statistically significant differences in the absolute efficiencies (\(\chi ^2(2)= 7.89\), \(p= 0.0194\)), the average distances (\(\chi ^2(2)= 9.62\), \(p= 0.0081\)), and the maximum distances (\(\chi ^2(2)= 8.18\), \(p= 0.0167\)) for GAMMA-PC, NSGA-II, and MOMA. While the absolute efficiency of GAMMA-PC cannot be proven to be different, the difference between its distance and the other two algorithms’ is statistically significant.
Table 9 presents the statistical evaluation of the interpretation function for \(I_C\). While it is proven that the values for GAMMA-PC belong to separate distributions than its counterparts, it cannot be proven that \((I_C(\)GAMMA-PC\(,B) = 1 \cap I_C(B, \)GAMMA-PC\() < 1)\) for either NSGA-II or MOMA. Therefore, its performance cannot be proven to be strictly better or worse than NSGA-II or MOMA by the binary coverage indicator.
Table 10 presents the statistical evaluation of Fig. 15. The samples of \(I_\varepsilon \) values comparing GAMMA-PC to NSGA-II and MOMA were both proven to belong to different distributions than their counterparts and to meet the necessary condition of \((I_\varepsilon (\)GAMMA-PC\(, B) \le 1 \cap I_\varepsilon (B, \)GAMMA-PC\() > 1)\). Comparing NSGA-II to MOMA showed that the difference in their \(I_\varepsilon \) values was statistically significant, but neither met the necessary condition to show better performance.
Table 11 presents the statistical evaluation of the maximum spread indicator for the toy dynamic problem. The Kruskal-Wallis test showed that there were statistically significant differences in the maximum spread indicators for GAMMA-PC, NSGA-II, and MOMA (\(\chi ^2(2)= 12.5\), \(p= 0.0019\)). Based on this evidence, student-t tests were applied to the differences between the spread values for GAMMA-PC and those for NSGA-II and MOMA respectively. Table 11 shows the results of these two tests, indicating that GAMMA-PC produces more diverse solutions than NSGA-II or MOMA.
Table 12 presents the statistical evaluation of Fig. 20. The distributions in all of the comparisons are shown to be significantly different, and none of the methods are proven to be better than the others.
Table 13 shows the statistical analysis of Fig. 21. It shows that the samples for GAMMA-PC are statistically different than its counterparts, but it does not support the hypothesis that GAMMA-PC performs better by this metric. MOMA is shown to have a lower average \(I_\varepsilon \) value than NSGA-II in Fig. 21c, but it also cannot be proven to perform better.
Table 14 presents the statistical evaluation of the maximum spread indicator for the full dynamic problem. The Kruskal-Wallis test showed that there were statistically signficant differences in the maximum spread indicators for GAMMA-PC, NSGA-II, and MOMA (\(\chi ^2(2)= 39.4\), \(p< 0.00001\)). Based on this evidence, student-t tests were applied to the differences in the spread values between GAMMA-PC and NSGA-II and between GAMMA-PC and MOMA. The alternative hypothesis was accepted for each test, indicating that GAMMA-PC produces more diverse solutions at a statistically significant level.
Rights and permissions
About this article
Cite this article
Spencer, K.Y., Tsvetkov, P.V. & Jarrell, J.J. A greedy memetic algorithm for a multiobjective dynamic bin packing problem for storing cooling objects. J Heuristics 25, 1–45 (2019). https://doi.org/10.1007/s10732-018-9382-0
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10732-018-9382-0