Abstract
With simple cost effective imaging solutions being widely available these days, there has been an enormous rise in the number of images consumers have been taking. Due to this increase, searching, browsing and managing images in multi-media systems has become more complex. One solution to this problem is to divide images into albums for meaningful and effective browsing. We propose a novel automated, expression driven image album creation for consumer image management systems. The system groups images with faces having similar expressions into albums. Facial expressions of the subjects are grouped into albums by the Structural Similarity Index measure, which is based on the theory on how easily the human visual system can extract the shape information of a scene. We also propose a search by similar expression, in which the user can create albums by providing example facial expression images. A qualitative analysis of the performance of the system is presented on the basis of a user study.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Chu, W., Lee, Y., Yu, J.: Visual language model for face clustering in consumer photos. In: MM 2009: Proceedings of the seventeen ACM international conference on Multimedia. ACM, New York (2009)
Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active Appearance Models. In: Burkhardt, H., Neumann, B. (eds.) ECCV 1998. LNCS, vol. 1407, p. 484. Springer, Heidelberg (1998)
Drucker, S.M., Wong, C., Roseway, A., Glenner, S., Mar, S.D.: MediaBrowser: reclaiming the shoebox. In: AVI 2004: Proceedings of the working conference on Advanced visual interfaces, pp. 433–436. ACM, New York (2004)
Ekman, P., Friesen, W.V.: The Facial Action Coding System: A Technique for the Measurement of Facial Movement. In: Consulting Psychologists (1978)
Fasel, B., Luettin, J.: Automatic Facial Expression Analysis: A Survey. PRÂ 36(1) (2003)
Google. Google Picasa, http://picasa.google.com/
Graham, A., Garcia-Molina, H., Paepcke, A., Winograd, T.: Extreme Temporal Photo Browsing. In: Visual Interfaces to Digital Libraries [JCDL 2002 Workshop]. Springer, Heidelberg (2002)
Huang, G.B., Ramesh, M., Berg, T., Learned-Miller, E.: Labeled Faces in the Wild: A Database for Studying Face Recognition in Unconstrained Environments. University of Massachusetts, Amherst, Technical Report (2007)
Kuchinsky, A., Pering, C., Creech, M.L., Freeze, D., Serra, B., Gwizdka, J.: FotoFile: a consumer multimedia organization and retrieval system. In: CHI 1999: Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, New York (1999)
Lucey, S., Matthews, I., Hu, C., Ambadar, Z., Torre, F.d.l., Cohn, J.: AAM Derived Face Representations for Robust Facial Action Recognition. In: FGR 2006: Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition. IEEE Computer Society, Los Alamitos (2006)
Platt, J.C.: AutoAlbum: Clustering Digital Photographs using Probabilistic Model Merging. In: CBAIVL 2000: Proceedings of the IEEE Workshop on Content-based Access of Image and Video Libraries. IEEE Computer Society, Los Alamitos (2000)
Saragih, J., Göcke, R.: Learning AAM fitting through simulation. Pattern Recognition 42(11) (2009)
Viola, P.A., Jones, M.J.: Rapid Object Detection using a Boosted Cascade of Simple Features. In: CVPR (1) (2001)
Wallhoff, F.: Facial Expressions and Emotion Database (2006), http://www.mmk.ei.tum.de/~waf/fgnet/feedtum.html
Wang, Z., Bovik, A.C., Sheikh, H.R., Student Member, Simoncelli, E.P., and Senior Member.: Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing, 600–612 (2004)
Yahoo. Flickr, http://www.flickr.com
Zhang, L., Chen, L., Li, M., Zhang, H.: Automated annotation of human faces in family albums. In: MULTIMEDIA 2003: Proceedings of the Eleventh ACM International Conference on Multimedia. ACM, New York (2003)
Zhang, T., Xiao, J., Wen, D., Ding, X.: Face based image navigation and search. In: MM 2009: Proceedings of the Seventeen ACM International Conference on Multimedia. ACM, New York (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Dhall, A., Asthana, A., Goecke, R. (2010). Facial Expression Based Automatic Album Creation. In: Wong, K.W., Mendis, B.S.U., Bouzerdoum, A. (eds) Neural Information Processing. Models and Applications. ICONIP 2010. Lecture Notes in Computer Science, vol 6444. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-17534-3_60
Download citation
DOI: https://doi.org/10.1007/978-3-642-17534-3_60
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-17533-6
Online ISBN: 978-3-642-17534-3
eBook Packages: Computer ScienceComputer Science (R0)