Skip to main content
SpringerLink
Log in

Towards Egocentric Sentiment Analysis

  • Conference paper
  • First Online:
Computer Aided Systems Theory – EUROCAST 2017 (EUROCAST 2017)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 10672))

Included in the following conference series:

Abstract

The availability and use of egocentric data are rapidly increasing due to the growing use of wearable cameras. Our aim is to study the effect (positive, neutral or negative) of egocentric images or events on an observer. Given egocentric photostreams capturing the wearer’s days, we propose a method that aims to assign sentiment to events extracted from egocentric photostreams. Such moments can be candidates to retrieve according to their possibility of representing a positive experience for the camera’s wearer. The proposed approach obtained a classification accuracy of 75% on the test set, with deviation of 8%. Our model makes a step forward opening the door to sentiment recognition in egocentric photostreams.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    http://www.imagga.com/solutions/auto-tagging.html.

  2. 2.

    http://wordnet.princeton.edu.

  3. 3.

    http://getnarrative.com/.

References

  1. Beck, J., et al.: Stimulating therapeutic change with interpretations: a comparison of positive and negative connotation. Couns. Psychol. 29, 551 (1986)

    Article  Google Scholar 

  2. Borth, D., Ji, R., Chen, T., Breuel, T., Chang, S.-F.: Large-scale visual sentiment ontology and detectors using adjective noun pairs, pp. 223–232. ACM (2013)

    Google Scholar 

  3. Campos, V., et al.: Diving deep into sentiment: understanding fine-tuned CNNs for visual sentiment prediction. In: ASM, pp. 57–62 (2015)

    Google Scholar 

  4. Chen, T., Borth, D., Darrell, T., Chang, S.-F.: DeepSentiBank: Visual Sentiment Concept Classification with Deep Convolutional Neural Networks, p. 7 (2014)

    Google Scholar 

  5. Dan-Glauser, E.S., Scherer, K.R.: The Geneva affective picture database (GAPED): a new 730-picture database focusing on valence and normative significance. Behav. Res. Methods 43(2), 468–477 (2011)

    Article  Google Scholar 

  6. Dimiccoli, M., Talavera, E., Nikolov, S.G., Radeva, P.: SR-Clustering: Semantic Regularized Clustering for Egocentric Photo Streams Segmentation (2015)

    Google Scholar 

  7. Lang, P., Bradley, M., Cuthbert, B.: International affective picture system (IAPS): technical manual and affective ratings. In: NIMH, pp. 39–58 (1997)

    Google Scholar 

  8. Levi, G., Hassner, T.: Emotion recognition in the wild via convolutional neural networks and mapped binary patterns. In: ICMI, pp. 503–510 (2015)

    Google Scholar 

  9. Ma, M., Fan, H., Kitani, K.M.: Going deeper into first-person activity recognition. In: CVPR (2016)

    Google Scholar 

  10. Machajdik, J., Hanbury, A.: Affecitve image classification using features inspired by psychology and art theory. In: ICM, pp. 83–92 (2010)

    Google Scholar 

  11. Nojavanasghar, B., et al.: EmoReact: a multimodal approach and dataset for recognizing emotional responses in children. In: ICMI 2016, pp. 137–144 (2016)

    Google Scholar 

  12. Plutchik, R.: Emotion: A Psychoevolutionary Synthesis. Harper & Row, New York City (1980)

    Google Scholar 

  13. Poria, S., et al.: Fusing audio, visual and textual clues for sentiment analysis from multimodal content. Neurocomputing 174, 50–59 (2014)

    Article  Google Scholar 

  14. Santos, V., et al.: The role of positive emotion and contributions of positive psychology in depression treatment: systematic review. Clin. Pract. Epidemiol. Ment. Health: CP & EMH 9, 221–237 (2013)

    Article  Google Scholar 

  15. Talavera, E., Strisciuglio, N., Petkov, N., Radeva, P.: Sentiment recognition in egocentric photostreams. In: Alexandre, L.A., Salvador Sánchez, J., Rodrigues, J.M.F. (eds.) IbPRIA 2017. LNCS, vol. 10255, pp. 471–479. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-58838-4_52

    Chapter  Google Scholar 

  16. Wang, M., Cao, D., Li, L., Li, S., Ji, R.: Microblog sentiment analysis based on cross-media bag-of-words model. In: ICIMCS, pp. 76–80 (2014)

    Google Scholar 

  17. You, Q., et al.: Cross-modality consistent regression for joint visual-textual sentiment analysis of social multimedia. In: WSDM, pp. 13–22 (2016)

    Google Scholar 

  18. You, Q., et al.: Robust image sentiment analysis using progressively trained and domain transferred deep networks. In: AAAI, pp. 381–388 (2015)

    Google Scholar 

  19. You, Q., Luo, J., Jin, H., Yang, J.: Building a large scale dataset for image emotion recognition: the fine print and the benchmark, CoRR (2016)

    Google Scholar 

  20. Yuan, J., et al.: Sentribute: image sentiment analysis from a mid-level perspective categories and subject descriptors. In: WISDOM, pp. 101–108 (2013)

    Google Scholar 

Download references

Acknowledgements

This work was partially founded by Ministerio de Ciencia e Innovación of the Gobierno de España, through the research project TIN2015-66951-C2. SGR 1219, CERCA, ICREA Academia 2014 and Grant 20141510 (Marató TV3). The funders had no role in the study design, data collection, analysis, and preparation of the manuscript.

Author information

Authors and Affiliations

  1. University of Barcelona, Barcelona, Spain

    Estefania Talavera, Petia Radeva & Nicolai Petkov

  2. University of Groningen, Groningen, The Netherlands

    Estefania Talavera & Nicolai Petkov

Authors
  1. Estefania Talavera
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Petia Radeva
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Nicolai Petkov
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Estefania Talavera .

Editor information

Editors and Affiliations

  1. University of Las Palmas de Gran Canaria, Las Palmas de Gran Canaria, Spain

    Roberto Moreno-Díaz

  2. Johannes Kepler University Linz, Linz, Austria

    Franz Pichler

  3. University of Las Palmas de Gran Canaria, Las Palmas de Gran Canaria, Spain

    Alexis Quesada-Arencibia

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Talavera, E., Radeva, P., Petkov, N. (2018). Towards Egocentric Sentiment Analysis. In: Moreno-Díaz, R., Pichler, F., Quesada-Arencibia, A. (eds) Computer Aided Systems Theory – EUROCAST 2017. EUROCAST 2017. Lecture Notes in Computer Science(), vol 10672. Springer, Cham. https://doi.org/10.1007/978-3-319-74727-9_35

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-74727-9_35

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-74726-2

  • Online ISBN: 978-3-319-74727-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation