Abstract
In recent decades, multimedia data have been commonly generated and used in various domains, such as in healthcare and social media due to their ability of capturing rich information. But as they are unstructured and separated, how to fuse and integrate multimedia datasets and then learn from them effectively have been a main challenge to machine learning. We present a novel generalised decision level ensemble method (GDLEM) that combines the multimedia datasets at decision level. After extracting features from each of multimedia datasets separately, the method trains models independently on each media dataset and then employs a generalised selection function to choose the appropriate models to construct a heterogeneous ensemble. The selection function is defined as a weighted combination of two criteria: the accuracy of individual models and the diversity among the models. The framework is tested on multimedia data and compared with other heterogeneous ensembles. The results show that the GDLEM is more flexible and effective.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
More, S., Mishra, D.K.: Multimedia data mining: a survey. Int. J. Sci. Spirit. Bus. Technol. 1(1), 49–55 (2012)
Pouyanfar, S., et al.: Dynamic sampling in convolutional neural networks for imbalanced data classification. In: 2018 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR), pp. 112–117. IEEE (2018)
Zhu, W., Cui, P., Wang, Z., Hua, G.: Multimedia big data computing. IEEE Multimed. 22(3), 96-c3 (2015)
Wlodarczak, P., Soar, J., Ally, M.: Multimedia data mining using deep learning. In: 2015 Fifth International Conference on Digital Information Processing and Communications (ICDIPC), pp. 190–196. IEEE (2015)
Chen, M., Mao, S., Liu, Y.: Big data: a survey. Mob. Netw. Appl. 19(2), 171–209 (2014)
Kuang, Z., Li, Z., Zhao, T., Fan, J.: Deep multi-task learning for large-scale image classification. In: 2017 IEEE Third International Conference on Multimedia Big Data (BigMM), pp. 310–317, April 2017
Mojahed, A., Bettencourt-Silva, J.H., Wang, W., de la Iglesia, B.: Applying clustering analysis to heterogeneous data using similarity matrix fusion (SMF). In: Perner, P. (ed.) MLDM 2015. LNCS (LNAI), vol. 9166, pp. 251–265. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-21024-7_17
Wang, W.: Some fundamental issues in ensemble methods. In: IEEE International Joint Conference on Neural Networks, IJCNN 2008. (IEEE World Congress on Computational Intelligence), pp. 2243–2250. IEEE (2008)
Krawczyk, B., Minku, L.L., Gama, J., Stefanowski, J., Woźniak, M.: Ensemble learning for data stream analysis: a survey. Inf. Fusion 37, 132–156 (2017)
Woźniak, M., Graña, M., Corchado, E.: A survey of multiple classifier systems as hybrid systems. Inf. Fusion 16, 3–17 (2014)
Alyahyan, S., Farrash, M., Wang, W.: Heterogeneous ensemble for imaginary scene classification. In: Proceedings of the 8th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K 2016), KDIR, Porto, Portugal, 9–11 November 2016, vol. 1, pp. 197–204 (2016)
Alyahyan, S., Wang, W.: Feature level ensemble method for classifying multi-media data. In: Bramer, M., Petridis, M. (eds.) SGAI 2017. LNCS (LNAI), vol. 10630, pp. 235–249. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-71078-5_21
Mojahed, A., de la Iglesia, B.: An adaptive version of k-medoids to deal with the uncertainty in clustering heterogeneous data using an intermediary fusion approach. Knowl. Inf. Syst. 50(1), 27–52 (2017)
Yamanishi, K.: Distributed cooperative Bayesian learning strategies. Inf. Comput. 150(1), 22–56 (1999)
Onan, A.: An ensemble scheme based on language function analysis and feature engineering for text genre classification. J. Inf. Sci. 44, 28–47 (2016). https://doi.org/10.1177/0165551516677911
Ballard, C., Wang, W.: Dynamic ensemble selection methods for heterogeneous data mining. In: 2016 12th World Congress on Intelligent Control and Automation (WCICA), pp. 1021–1026. IEEE (2016)
Amato, F., Moscato, V., Picariello, A., Sperlì, G.: Recommendation in social media networks. In: Third IEEE International Conference on Multimedia Big Data, Laguna Hills, CA, USA, 19–21 April 2017 (2017)
Liu, H., Wei, Z., Chen, Y., Pan, J., Lin, L., Ren, Y.: Drone detection based on an audio-assisted camera array. In: Third IEEE International Conference on Multimedia Big Data, Laguna Hills, CA, USA, 19–21 April 2017, pp. 402–406. IEEE Computer Society (2017)
Giacinto, G., Roli, F.: Design of effective neural network ensembles for image classification purposes. Image Vis. Comput. 19(9), 699–707 (2001)
Partridge, D., Krzanowski, W.: Software diversity: practical statistics for its measurement and exploitation. Inf. Softw. Technol. 39(10), 707–717 (1997)
Witten, I.H., Frank, E., Hall, M.A., Pal, C.J.: Data Mining: Practical Machine Learning Tools and Techniques. Morgan Kaufmann, Burlington (2016)
Oliva, A., Torralba, A.: Modeling the shape of the scene: a holistic representation of the spatial envelope. Int. J. Comput. Vis. 42(3), 145–175 (2001)
Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005, vol. 1, pp. 886–893. IEEE (2005)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Alyahyan, S., Wang, W. (2018). Generalised Decision Level Ensemble Method for Classifying Multi-media Data. In: Bramer, M., Petridis, M. (eds) Artificial Intelligence XXXV. SGAI 2018. Lecture Notes in Computer Science(), vol 11311. Springer, Cham. https://doi.org/10.1007/978-3-030-04191-5_28
Download citation
DOI: https://doi.org/10.1007/978-3-030-04191-5_28
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-04190-8
Online ISBN: 978-3-030-04191-5
eBook Packages: Computer ScienceComputer Science (R0)