Abstract
Our survey paper attempts to investigate how recent and undoubted emerge in enriched, geo-tagged social networks’ multimedia content sharing works to the benefit of their users and whether it could be handled in a formal way, in order to capture the meaningful semantics rising from this newly introduced user experience. It further specializes its focus by providing an overview of current state-of-the-art techniques with respect to geo-tagged content access, processing and manipulation within the popular Flickr social network. In this manner it explores the role of information retrieval, integration and extraction from the technical point of view, coupled together with human social network activities, like, for instance, localization and recommendations based on pre-processed collaborative geo-tagged photos, resulting into more efficient, optimized search results.
Chapter PDF
References
Dugan, M., Smith, A.: Social media update 2013 (2013), http://pewinternet.org/Reports/2013/Social-Media-Update.aspx
Lenhart, A., Purcell, K., Smith, A., Zickuhr, K.: Social media & mobile internet use among teens and young adults (2010), http://pewinternet.org/Reports/2010/Social-Media-and-Young-Adults.aspx
Nov, O., Naaman, M., Ye, C.: Analysis of participation in an online photo-sharing community: A multidimensional perspective. Journal of the American Society for Information Science and Technology 61(3), 555–566 (2010)
Van House, N.A.: Flickr and public image-sharing: distant closeness and photo exhibition. In: Proc. of ACM CHI (2007)
Van Dijck, J.: Flickr and the culture of connectivity: Sharing views, experiences, memories. Memory Studies 4(4), 401–415 (2011)
Flanagin, A.J., Metzger, M.J.: The credibility of volunteered geographic information. Geo Journal 72(3-4), 137–148 (2008)
Spielman, S.E.: Spatial collective intelligence? credibility, accuracy, and volunteered geographic information. Cartography and Geographic Information Science (ahead-of-print), 1–10 (2014)
Luo, J., Joshi, D., Yu, J., Gallagher, A.: Geotagging in multimedia and computer vision a survey. Multimedia Tools and Applications 51(1), 187–211 (2011)
Wu, J., Sun, H., Tan, Y.: Social media research: A review. Journal of Systems Science and Systems Engineering 22(3), 257–282 (2013)
Abbasi, R., Chernov, S., Nejdl, W., Paiu, R., Staab, S.: Exploiting flickr tags and groups for finding landmark photos. In: Boughanem, M., Berrut, C., Mothe, J., Soule-Dupuy, C. (eds.) ECIR 2009. LNCS, vol. 5478, pp. 654–661. Springer, Heidelberg (2009)
Ahern, S., Naaman, M., Nair, R., Yang, J.H.-I.: World explorer: visualizing aggregate data from unstructured text in geo-referenced collections. In: Proc. of the ACM/IEEE-CS JCDL (2007)
Serdyukov, P., Murdock, V., Zwol, R.V.: Placing flickr photos on a map. In: Proc. of ACM SIGIR (2009)
Venetis, P., Koutrika, G., Garcia-Molina, H.: On the selection of tags for tag clouds. In: Proc. of ACM WSDM (2011)
Lerman, K., Plangprasopchok, A., Wong, C.: Personalizing image search results on flickr (2007)
Larson, M., Kofler, C., Hanjalic, A.: Reading between the tags to predict real-world size-class for visually depicted objects in images. In: Proc. of ACM MM, pp. 273–282 (2011)
Wang, G., Hoiem, D., Forsyth, D.: Learning image similarity from flickr groups using stochastic intersection kernel machines. In: Proc. of IEEE ICCV (2009)
Chatzilari, E., Nikolopoulos, S., Papadopoulos, S., Zigkolis, C., Kompatsiaris, Y.: Semi-supervised object recognition using flickr images. In: Proc. of IEEE CBMI (2011)
Philbin, J., Zisserman, A.: Object mining using a matching graph on very large image collections. In: Proc. of IEEE ICVGIP (2008)
Avrithis, Y., Kalantidis, Y., Tolias, G., Spyrou, E.: Retrieving landmark and non-landmark images from community photo collections. In: Proc. of ACM MM (2010)
Yanai, K., Kawakubo, H., Qiu, B.: A visual analysis of the relationship between word concepts and geographical locations. In: Proc. of ACM ICIVP (2009)
Li, Y., Crandall, D.J., Huttenlocher, D.P.: Landmark classification in large-scale image collections. In: Proc. of IEEE ICCV (2009)
Joshi, D., Luo, J.: Inferring generic activities and events from image content and bags of geo-tags. In: Proc. of ACM CBIVR (2008)
Yu, J., Luo, J.: Leveraging probabilistic season and location context models for scene understanding. In: Proc. of ACM CBIVR (2008)
Luo, J., Yu, J., Joshi, D., Hao, W.: Event recognition: viewing the world with a third eye. In: Proc. of ACM MM (2008)
Batko, M., Falchi, F., Lucchese, C., Novak, D., Perego, R., Rabitti, F., Sedmidubsky, J., Zezula, P.: Building a web-scale image similarity search system. Multimedia Tools and Applications 47(3), 599–629 (2010)
Seah, B.-S., Bhowmick, S.S., Sun, A.: Summarizing social image search results. In: Proc. of ACM WWW Companion (2014)
Moëllic, P.-A., Haugeard, J.E., Pitel, G.: Image clustering based on a shared nearest neighbors approach for tagged collections. In: Proc. of ACM CIVR (2008)
Liu, S., Cui, P., Luan, H., Zhu, W., Yang, S., Tian, Q.: Social-oriented visual image search. Computer Vision and Image Understanding 118, 30–39 (2014)
Barrios, J.M., Dıaz-Espinoza, D., Bustos, B.: Text-based and content-based image retrieval on flickr: Demo
Crandall, D.J., Backstrom, L., Huttenlocher, D., Kleinberg, J.: Mapping the world’s photos. In: Proc. of ACM WWW (2009)
Quack, T., Leibe, B., Van Gool, L.: World-scale mining of objects and events from community photo collections. In: Proc. of ACM CIVR (2008)
Gammeter, S., Bossard, L., Quack, T., Gool, L.V.: I know what you did last summer: object-level auto-annotation of holiday snaps. In: Proc. of IEEE ICCV (2009)
Li, X., Snoek, C.G., Worring, M.: Learning tag relevance by neighbor voting for social image retrieval. In: Proc of ACM MIR (2008)
Moxley, E., Kleban, J., Xu, J., Manjunath, B.S.: Not all tags are created equal: Learning flickr tag semantics for global annotation. In: Proc. of IEEE ICME (2009)
Rattenbury, T., Good, N., Naaman, M.: Towards automatic extraction of event and place semantics from flickr tags. In: Proc. of ACM SIGIR (2007)
Ulges, A., Worring, M., Breuel, T.: Learning visual contexts for image annotation from flickr groups. IEEE Trans. on Multimedia 13(2), 330–341 (2011)
Fan, J., Keim, D.A., Gao, Y., Luo, H., Li, Z.: Justclick: Personalized image recommendation via exploratory search from large-scale flickr images. IEEE Trans. on Circuits and Systems for Video Technology 19(2), 273–288 (2009)
Simon, I., Snavely, N., Seitz, S.M.: Scene summarization for online image collections. In: Proc. of ICCV (2007)
Kennedy, L.S., Naaman, M.: Generating diverse and representative image search results for landmarks. In: Proc. of ACM WWW (2008)
Liu, B., Yuan, Q., Cong, G., Xu, D.: Where your photo is taken: Geolocation prediction for social images. Journal of the Association for Information Science and Technology (2014)
Chen, H.M., Chang, M.H., Chang, P.C., Tien, M.C., Hsu, W.H., Wu, J.L.: Sheepdog: group and tag recommendation for flickr photos by automatic search-based learning. In: Proc. of ACM MM (2008)
Anderson, A., Ranghunathan, K., Vogel, A.: Tagez: Flickr tag recommendation. Association for the Advancement of Artificial Intelligence (2008)
Chaudhry, O., Mackaness, W.: Automated extraction and geographical structuring of flickr tags. In: Proc. of GEOProcessing (2012)
Hsieh, L.C., Hsu, W.H.: Search-based automatic image annotation via flickr photos using tag expansion. In: Proc. of IEEE ICASSP (2010)
Kennedy, L., Naaman, M., Ahern, S., Nair, R., Rattenbury, T.: How flickr helps us make sense of the world: context and content in community-contributed media collections. In: Proc. of ACM MM (2007)
Sigurbjörnsson, B., Van Zwol, R.: Flickr tag recommendation based on collective knowledge. In: Proc. of ACM WWW (2008)
Garg, N., Weber, I.: Personalized tag suggestion for flickr. In: Proc. of ACM WWW (2008)
Garg, N., Weber, I.: Personalized, interactive tag recommendation for flickr. In: Proc. of ACM RecSys (2008)
Moxley, E., Kleban, J., Manjunath, B.S.: Spirittagger: a geo-aware tag suggestion tool mined from flickr. In: Proc. of ACM MIR (2008)
Popescu, A., Moëllic, P.-A.: Monuanno: automatic annotation of georeferenced landmarks images. In: Proc. of ACM CIVR (2009)
Kleban, J., Moxley, E., Xu, J., Manjunath, B.S.: Global annotation on georeferenced photographs. In: Proc. of ACM CIVR (2009)
Chen, X., Shin, H.: Tag recommendation by machine learning with textual and social features. Journal of Intelligent Information Systems 40(2), 261–282 (2013)
Kelm, P., Schmiedeke, S., Sikora, T.: A hierarchical, multi-modal approach for placing videos on the map using millions of flickr photographs. In: Proc. of ACM SBNMA (2011)
Van Laere, O., Schockaert, S., Dhoedt, B.: Combining multi-resolution evidence for georeferencing flickr images. In: Deshpande, A., Hunter, A. (eds.) SUM 2010. LNCS, vol. 6379, pp. 347–360. Springer, Heidelberg (2010)
De Rouck, C., Van Laere, O., Schockaert, S., Dhoedt, B.: Georeferencing wikipedia pages using language models from flickr (2011)
Friedland, G., Choi, J., Lei, H., Janin, A.: Multimodal location estimation on flickr videos. In: Proc. of ACM WSM (2011)
Hauff, C., Houben, G.-J.: Geo-location estimation of flickr images: Social web based enrichment. In: Baeza-Yates, R., de Vries, A.P., Zaragoza, H., Cambazoglu, B.B., Murdock, V., Lempel, R., Silvestri, F. (eds.) ECIR 2012. LNCS, vol. 7224, pp. 85–96. Springer, Heidelberg (2012)
Van Laere, O., Schockaert, S., Dhoedt, B.: Towards automated georeferencing of flickr photos. In: Proc. of ACM GIR (2010)
Van Laere, O., Schockaert, S., Dhoedt, B.: Finding locations of flickr resources using language models and similarity search. In: Proc. of ACM ICMR (2011)
Friedland, G., Choi, J., Janin, A.: Video2gps: a demo of multimodal location estimation on flickr videos. In: Proc. of ACM MM (2011)
Kalantidis, Y., Tolias, G., Avrithis, Y., Phinikettos, M., Spyrou, E., Mylonas, P., Kollias, S.: Viral: Visual image retrieval and localization. Multimedia Tools and Applications 51(2), 555–592 (2011)
Spyrou, E., Mylonas, P.: Placing user-generated photo metadata on a map. In: Proc. of IEEE SMAP (2011)
Joshi, D., Gallagher, A., Yu, J., Luo, J.: Exploring user image tags for geo-location inference. In: Proc. of IEEE ICASSP (2010)
Gallagher, A., Joshi, D., Yu, J., Luo, J.: Geo-location inference from image content and user tags. In: Proc. of IEEE CVPR (2009)
Hays, J., Efros, A.A.: Im2gps: estimating geographic information from a single image. In: Proc. of IEEE CVPR (2008)
Kalogerakis, E., Vesselova, O., Hays, J., Efros, A.A., Hertzmann, A.: Image sequence geolocation with human travel priors. In: Proc. of IEEE ICCV (2009)
O’Hare, N., Murdock, V.: Modeling locations with social media. Information Retrieval 16(1), 30–62 (2013)
Hare, J., Davies, J., Samangooei, S., Lewis, P.H.: Placing photos with a multimodal probability density function
Li, J., Qian, X., Tang, Y.Y., Yang, L., Mei, T.: Gps estimation for places of interest from social users’ uploaded photos. IEEE Transactions on Multimedia 15(8), 2058–2071 (2013)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 IFIP International Federation for Information Processing
About this paper
Cite this paper
Spyrou, E., Mylonas, P. (2014). A Survey of Geo-tagged Multimedia Content Analysis within Flickr. In: Iliadis, L., Maglogiannis, I., Papadopoulos, H., Sioutas, S., Makris, C. (eds) Artificial Intelligence Applications and Innovations. AIAI 2014. IFIP Advances in Information and Communication Technology, vol 437. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-44722-2_14
Download citation
DOI: https://doi.org/10.1007/978-3-662-44722-2_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-662-44721-5
Online ISBN: 978-3-662-44722-2
eBook Packages: Computer ScienceComputer Science (R0)