Abstract
The multi-instance multi-label learning (MIML) framework is an extension of the multi-label learning, where each object in MIML is represented by a multi-instance bag and associated with a multi-label vector. Recently, extreme learning machine (ELM) has been widely used in multi-instance multi-label classification due to its short runtime. Simultaneously, ELM also has good classification accuracy compared to other neural network models. However, this type of ELM-based MIML classification algorithms can easily lead to overfitting problems during training and the basic ELM algorithm with random initial weights and biases is not stable. In order to solve the above problems, ensemble learning is used to overcome overfitting problems and regression kernel extreme learning machine (RKELM) as classifier instead of the basic ELM effectively can solve the problem of instability of training. In this paper, Bagging-based RKELM (BRKELM) and AdaBoost-based RKELM (ARKELM) for MIML classifications are proposed. The comparison with other state-of-the-art multi-instance multi-label learning algorithms shows that the BRKELM and ARKELM are highly efficient, feasible and stable algorithms.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Zhang, M.L., Zhou, Z.H.: A review on multi-label learning algorithms. IEEE Trans. Knowl. Data Eng. 26(8), 1819–1837 (2014)
Wu, J., Pan, S., Zhu, X., et al.: Multi-instance learning with discriminative bag mapping. IEEE Trans. Knowl. Data Eng. 30(6), 1065–1080 (2018)
Zhou, Z.H., Zhang, M.L.: Multi-instance multi-label learning with application to scene classification. In: Advances in Neural Information Processing Systems, pp. 1609–1616 (2007)
Zhou, Z.H., Zhang, M.L., Huang, S.J., et al.: Multi-instance multi-label learning. Artif. Intell. 176(1), 2291–2320 (2012)
Zhang, M.L.: A k-nearest neighbor based multi-instance multi-label learning algorithm. In: The 22nd IEEE International Conference on Tools with Artificial Intelligence (ICTAI), pp. 207–212 (2010)
Mercan, C., Aksoy, S., Mercan, E., et al.: Multi-instance multi-label learning for multi-class classification of whole slide breast histopathology images. IEEE Trans. Med. Imag. 37(1), 316–325 (2018)
Yan, K., Li, Z., Zhang, C.: A New multi-instance multi-label learning approach for image and text classification. Multimed. Tools Appl. 75(13), 7875–7890 (2016)
Wu, J.S., Huang, S.J., Zhou, Z.H.: Genome-wide protein function prediction through multi-instance multi-label learning. IEEE/ACM Trans. Comput. Biol. Bioinf. 11(5), 891–902 (2014)
Wu, J., Zhu, W., Jiangm, Y., et al.: Predicting protein functions of bacteria genomes via multi-instance multi-label active learning. In: 2018 IEEE 3rd International Conference on Integrated Circuits and Microsystems (ICICM), pp. 302–307. IEEE (2018)
Li, Y.F., Hu, J.H., Jiang, Y., et al.: Towards discovering what patterns trigger what labels. In: The 26th AAAI Conference on Artificial Intelligence, pp. 1012–1018 (2012)
Huang, S.J., Gao, W., Zhou, Z H.: Fast multi-instance multi-label learning. IEEE Trans. Pattern Anal. Mach. Intell. (2018)
Huang, G.B., Zhu, Q.Y., Siew, C.K.: Extreme learning machine: a new learning scheme of feedforward neural networks. In: 2004 Proceedings of International Joint Conference on Neural Networks (IJCNN 2004), vol. 2, pp. 985–990 (2004)
Yin, Y., Zhao, Y., Li, C., et al.: Improving multi-instance multi-label learning by extreme learning machine. Appl. Sci. 6(6), 160 (2016)
Huang, G.B., Zhou, H., Ding, X., et al.: Extreme learning machine for regression and multiclass classification. IEEE Trans. Syst. Man Cybern. Part B (Cybern.) 42(2), 513–529 (2012)
Van Heeswijk, M., Miche, Y., Oja, E., et al.: GPU-accelerated and parallelized ELM ensembles for large-scale regression. Neurocomputing 74(16), 2430–2437 (2011)
Liu, N., Wang, H.: Ensemble based extreme learning machine. IEEE Signal Process. Lett. 17(8), 754–757 (2010)
Samat, A., Du, P., Liu, S., et al.: E2LMs: ensemble extreme learning machines for hyperspectral image classification. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 7(4), 1060–1069 (2014)
Huang, G., Huang, G.B., Song, S., et al.: Trends in extreme learning machines: a review. Neural Netw. 61, 32–48 (2015)
Sebastiani, F.: Machine learning in automated text categorization. ACM Comput. Surv. (CSUR) 34(1), 1–47 (2002)
Briggs, F., Fern, X.Z., Raich, R.: Rank-loss support instance machines for MIML instance annotation. In: The 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 534–542 (2012)
Guo, H.F., Han, L., Su, S., et al.: Deep multi-instance multi-label learning for image annotation. Int. J. Pattern Recogn. Artif. Intell. 32(03), 1859005 (2018)
Teisseyre, P.: CCnet: joint multi-label classification and feature selection using classifier chains and elastic net regularization. Neurocomputing 235, 98–111 (2017)
Demšar, J.: Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7, 1–30 (2006)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Wang, Y., Pei, G., Cheng, Y. (2019). Ensemble Regression Kernel Extreme Learning Machines for Multi-Instance Multi-Label Learning. In: Knight, K., Zhang, C., Holmes, G., Zhang, ML. (eds) Artificial Intelligence. ICAI 2019. Communications in Computer and Information Science, vol 1001. Springer, Singapore. https://doi.org/10.1007/978-981-32-9298-7_18
Download citation
DOI: https://doi.org/10.1007/978-981-32-9298-7_18
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-32-9297-0
Online ISBN: 978-981-32-9298-7
eBook Packages: Computer ScienceComputer Science (R0)
