Abstract
Artistic image understanding is an interdisciplinary research field of increasing importance for the computer vision and art history communities. One of the goals of this field is the implementation of a system that can automatically retrieve and annotate artistic images. The best approach in the field explores the artistic influence among different artistic images using graph-based learning methodologies that take into consideration appearance and label similarities, but the current state-of-the-art results indicate that there seems to be lots of room for improvements in terms of retrieval and annotation accuracy. In order to improve those results, we introduce novel human figure composition features that can compute the similarity between artistic images based on the location and number (i.e., composition) of human figures. Our main motivation for developing such features lies in the importance that composition (particularly the composition of human figures) has in the analysis of artistic images when defining the visual classes present in those images. We show that the introduction of such features in the current dominant methodology of the field improves significantly the state-of-the-art retrieval and annotation accuracies on the PRINTART database, which is a public database exclusively composed of artistic images.
Chapter PDF
Similar content being viewed by others
References
Carneiro, G., da Silva, N.P., Del Bue, A., Costeira, J.P.: Artistic image classification: an analysis on the PRINTART database. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part IV. LNCS, vol. 7575, pp. 143–157. Springer, Heidelberg (2012)
Carneiro, G.: Artistic image analysis using graph-based learning approaches. IEEE Transactions on Image Processing 22(8), 3168–3178 (2013)
Berezhnoy, I., Postma, E., van den Herik, H.: Computerized visual analysis of paintings. In: Int. Conf. Association for History and Computing, pp. 28–32 (2005)
Lyu, S., Rockmore, D., Farid, H.: A digital technique for art authentication. Proceedings of the National Academy of Sciences USA 101(49), 17006–17010 (2004)
Polatkan, G., Jafarpour, S., Brasoveanu, A., Hughes, S., Daubechies, I.: Detection of forgery in paintings using supervised learning. In: International Conference on Image Processing (2009)
Graham, D., Friedenberg, J., Rockmore, D., Field, D.: Mapping the similarity space of paintings: image statistics and visual perception. Visual Cognition 18(4), 559–573 (2010)
Hughes, J., Graham, D., Rockmore, D.: Stylometrics of artwork: uses and limitations. In: Proceedings of SPIE: Computer Vision and Image Analysis of Art (2010)
Jafarpour, S., Polatkan, G., Daubechies, I., Hughes, S., Brasoveanu, A.: Stylistic analysis of paintings using wavelets and machine learning. In: European Signal Processing Conference (2009)
Li, J., Wang, J.: Studying digital imagery of ancient paintings by mixtures of stochastic models. IEEE Trans. Image Processing 13(3), 340–353 (2004)
Yelizaveta, M., Tat-Seng, C., Jain, R.: Semi-supervised annotation of brushwork in paintings domain using serial combinations of multiple experts. In: ACM Multimedia, pp. 529–538 (2006)
Datta, R., Joshi, D., Li, J., Wang, J.: Image retrieval: Ideas, influences, and trends of the new age. ACM Comput. Surv. 40(2) (2008)
Abe, K., Saleh, B., Elgammal, A.: An early framework for determining artistic influence. In: Petrosino, A., Maddalena, L., Pala, P. (eds.) ICIAP 2013. LNCS, vol. 8158, pp. 198–207. Springer, Heidelberg (2013)
Lowe, D.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision (2004). (paper accepted for publication)
Lazebnik, S., Schmid, C., Ponce, J.: Beyond bags of features, spatial pyramid matching for recognizing natural scene categories. In: CVPR (2006)
Nistér, D., Stewénius, H.: Scalable recognition with a vocabulary tree. In: CVPR, pp. 2161–2168 (2006)
Grady, L.: Random walks for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 28(11), 1768–1783 (2006)
Fan, H., Cao, Z., Jiang, Y., Yin, Q., Doudou, C.: Learning deep face representation. arXiv preprint arXiv:1403.2802 (2014)
Viola, P., Jones, M.J.: Robust real-time face detection. International journal of computer vision 57(2), 137–154 (2004)
Nowak, S., Lukashevich, H., Dunker, P., Rüger, S.: Performance measures for multilabel evaluation: a case study in the area of image classification. In: Multimedia Information Retrieval, pp. 35–44 (2010)
Arnheim, R.: Art and visual perception: A psychology of the creative eye. Univ. of California Press (1954)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Chen, Q., Carneiro, G. (2015). Artistic Image Analysis Using the Composition of Human Figures. In: Agapito, L., Bronstein, M., Rother, C. (eds) Computer Vision - ECCV 2014 Workshops. ECCV 2014. Lecture Notes in Computer Science(), vol 8925. Springer, Cham. https://doi.org/10.1007/978-3-319-16178-5_8
Download citation
DOI: https://doi.org/10.1007/978-3-319-16178-5_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-16177-8
Online ISBN: 978-3-319-16178-5
eBook Packages: Computer ScienceComputer Science (R0)