Skip to content
Licensed Unlicensed Requires Authentication Published by De Gruyter Mouton September 21, 2022

The digital approach to semiotics: a systematic review

  • Inmaculada Berlanga-Fernández

    Inmaculada Berlanga-Fernández received her PhD in Philology and PhD in Social Science (Audiovisual Communication) from University of Granada and is currently Full Professor at Universidad Internacional de La Rioja. Her research interests include rhetorics, semiotcs, persuasive communication. She has published numerous papers on these topics in peer-reviewed journals and peer-reviewed conference proceedings. She is coordinator of «Procomm» Investigation Group.

    ORCID logo EMAIL logo
    and Everardo Reyes

    Everardo Reyes received his PhD from University of Paris 8, where he is currently Full Professor and co-director of the Masters in Digital Humanities. He is also a member of Labortoire Paragraphe as well as treasurer and member of the Bureau of the International Association for Visual Semiotics. His research interests include information design, media art, hypermedia, and digital culture.

    ORCID logo
From the journal Text & Talk

Abstract

This article traces the presence of the concept digital semiotics in scientific literature with the aim of constituting a corpus of study that would allow to identify its goals and fields of interest. We undertook a systematic review of the term in the most important academic databases. We obtained 389 records and analyzed each of them in terms of publication date, type, content, and synthesis of contributions that develop distinct lines of investigation in digital semiotics. The results show a reduced number of first level publications that approach in detail this object of inquiry while establishing multimodal semiotics and social semiotics as the most consolidated branches. However, we found an increasing amount of gray literature that paves the way towards a deeper semiotic research tradition in the 21st century. We conclude by calling for a revision of semiotics, understood as a field of study that brings together interdisciplinary relationships and methodological solutions that interrogate the digital culture.


Corresponding author: Inmaculada Berlanga-Fernández, Department of Humanities and Social Science, Universidad Internacional de la Rioja, Avenida de la Paz s/n, 26006, Logroño, La Rioja, Spain, E-mail:

About the authors

Inmaculada Berlanga-Fernández

Inmaculada Berlanga-Fernández received her PhD in Philology and PhD in Social Science (Audiovisual Communication) from University of Granada and is currently Full Professor at Universidad Internacional de La Rioja. Her research interests include rhetorics, semiotcs, persuasive communication. She has published numerous papers on these topics in peer-reviewed journals and peer-reviewed conference proceedings. She is coordinator of «Procomm» Investigation Group.

Everardo Reyes

Everardo Reyes received his PhD from University of Paris 8, where he is currently Full Professor and co-director of the Masters in Digital Humanities. He is also a member of Labortoire Paragraphe as well as treasurer and member of the Bureau of the International Association for Visual Semiotics. His research interests include information design, media art, hypermedia, and digital culture.

References

Abel, David L. 2011. The three fundamental categories of reality. In David L. Abel (ed.), The first eene: The birth of programming, messaging and formal control, 19–54. New York: LongView Press-Academic.Search in Google Scholar

Adami, Elisabetta. 2018. Styling the self-online: Semiotic technologization in weblog publishing. Social Semiotics 28(5). 601–622. https://doi.org/10.1080/10350330.2018.1504713.Search in Google Scholar

Adegoju, Adeyemi & Mohammed Ademilokun. 2015. Verbal and visual signifiers of advertising shares offers in Nigeria’s 2005 bank recapitalization. Discourse & Communication 9(5). 519–533. https://doi.org/10.1177/1750481315600300.Search in Google Scholar

Ademilokun, Mohammed. 2016. A multimodal analysis of the public discourse of the 2013 university lecturers? Strike in Nigeria. In Rotimi Taiwo & Tunde Opeibi (eds.), The discourse of digital civic engagement: Perspectives from the developing world, 57–73. New York: Nova Science Publishers.Search in Google Scholar

Ahonen, Pertti. 1993. A Copernican revolution in political research: Reflections on the rainbow of essays in this book. In Pertti Ahonen (ed.), Tracing the semiotic boundaries of politics, 1–28. Berlin: Mouton de Gruyter.10.1515/9783110859195.1Search in Google Scholar

Amann, Neslihan. 2017. Fantastik filmin dijitalleşmesi ve yeniden üretilen göstergelerin çözümlenmesi: Taht Oyunları (Game of Thrones) örneği [Digitization of fantasy film and analysis of reproduced signs: The case of Game of Thrones. https://openaccess.maltepe.edu.tr/xmlui/handle/20.500.12415/3643 (accessed 02 June 2020).Search in Google Scholar

Andrade, Eugenio. 2000. From external to internal measurement: A form theory approach to evolution. Biosystems 57(1). 49–62. https://doi.org/10.1016/s0303-2647(00)00082-4.Search in Google Scholar

Andrade, Eugenio. 2002. The organization of nature: Semiotic agents as intermediaries between digital and analog informational spaces. SEED Journal: Semiosis, Evolution Energy and Development 2(1). 56–84.Search in Google Scholar

Andrade, Eugenio. 2003. The emergence of natural hierarchies as an analog/digital driven process. SEED Journal: Semiosis, Evolution, Energy and Development 3(2). 24–46.Search in Google Scholar

Andrade, Eugenio. 2005. The interrelations between genotype/phenotype/environment: A semiotic contribution to the Evo: Devo Debate. SEED Journal: Semiosis, Evolution, Energy and Development 5(2). 1–39.Search in Google Scholar

Andrade, Eugenio. 2019. The processing of information (analog/digital) is the causal factor of the emergence of natural hierarchies. Ludus Vitalis 11(20). 85–106.Search in Google Scholar

Antunes, Janaina. 2016. The roles and challenges of semiotics unraveling big data in the glocal contemporaneity ruled by dromocracy. In Baranauskas M. Cecilia, Kecheng Liu, Lirio Sol, Vânia Paula de Almeida Neris, Rodrigo Bonacin & Keiichi Nakata (eds.), Socially aware organisations and technologie: Impact and challenges. ICISO 2016. IFIP advances in information and communication technology, vol. 477, 37–42. Campinas: Springer Link.10.1007/978-3-319-42102-5_4Search in Google Scholar

Baetens, Jan & Fred Truyen. 2013. Hypertext revisited. Leonardo 46(5). 477–480. https://doi.org/10.1162/leon_a_00644.Search in Google Scholar

Bankov, Kristian. 2018. Introduction: From text to interaction. Digital Age in Semiotics & Communication 1. 7–15. https://doi.org/10.33919/dasc.18.1.1.Search in Google Scholar

Bañuelos, Jacob. 2005. Intercambio cultural digital y nuevos simulacros. Enl@ce: Revista venezolana de información, tecnología y conocimiento 2(3). 93–107.Search in Google Scholar

Bateman, John A. 2017. Multimodal semiotics and the theoretical foundations of digital humanities. Zeitschrift fur Semiotik 39(1–2). 11–50.Search in Google Scholar

Berlanga, Inmaculada & Francisco García. 2013. Ciberretórica. Aristóteles en las redes sociales. Madrid: Fragua.Search in Google Scholar

Berlanga, Inmaculada, Borja Arjona & Adoración Merino. 2018. Digital semiotics in fiction series El Ministerio del Tiempo. Signa 27. 233–262.10.5944/signa.vol27.2018.18413Search in Google Scholar

Bezemer, Jeff & Gunther Kress. 2015. Multimodality, learning and communication: A social semiotic frame. London: Routledge.10.4324/9781315687537Search in Google Scholar

Castell, Manuel. 1999. Internet y la sociedad red. Lección inaugural del programa de doctorado sobre la sociedad de la información y el conocimiento. Barcelona: UOC. https://red.pucp.edu.pe/wp-content/uploads/biblioteca/Castells_internet.pdf (accessed 30 April 2020).Search in Google Scholar

China, Addie Sayers. 2020. Racialization and gender in tumblr: Beyoncé as a raciolinguistic semiotic resource. International Journal of the Sociology of Language 265. 81–105. https://doi.org/10.1515/ijsl-2020-2104.Search in Google Scholar

Cobley, Paul & Lizza Jansz. 2014. Introducing semiotics: A graphic guide. London: Icon Books Ltd.Search in Google Scholar

Cobley, Paul (ed.). 2009. The Routledge companion to semiotics. London: Routledge.10.4324/9780203874158Search in Google Scholar

Cocchiarella, Luigi. 2015. Colloquium with Ruggero Eugeni. In Luigi Cocchiarella (ed.), The visual language of technique, 5–10. London: Springer.10.1007/978-3-319-05350-9_2Search in Google Scholar

Coe, Richard M. 1990. Defining rhetoric—and us. Journal of Advanced Composition 10(1). 39–52.10.2307/377419Search in Google Scholar

Coe, Richard M. 1994. Defining rhetoric—and us: A meditation on Burke’s definitions. In Gary Olson & Sidney Dobrin (eds.), Composition theory for the postmodern classroom, 332–344. New York: State University of New York.Search in Google Scholar

Cosenza, Giovanna. 2014. Introduzione alla semiotica dei nuovi media. Bari: Gius. Laterza & Figli Spa.Search in Google Scholar

Dalmasso, María Teresa. 2008. Del giro lingüístico al giro semiótico? In Eva da Porta & Daniel Saur (eds.), Giros teóricos en las ciencias sociales y humanidades, 15–20. Córdoba: Comunicarte.Search in Google Scholar

Damayanti, Ika Lestari & Yusnita Febrianti. 2020. Multimodal literacy: Unfolding reading path in children’s picture book and its potential for EFL classrooms. Indonesian Journal of Applied Linguistics 9(3). 616–627. https://doi.org/10.17509/ijal.v9i3.23212.Search in Google Scholar

Danesi, Marcel. 2016. The semiotics of emoji: The rise of visual language in the age of the internet. London: Bloomsbury.Search in Google Scholar

De Souza, Clarisse S. 2005. The semiotic engineering of human-computer interaction. Cambridge, Mass.: The MIT Press.10.7551/mitpress/6175.001.0001Search in Google Scholar

De Souza, Clarisse S. 2013. Semiotic perspectives on interactive languages for life on the screen. Journal of Visual Languages & Computing 24(3). 218–221. https://doi.org/10.1016/j.jvlc.2013.03.002.Search in Google Scholar

Dittus, Rubén. 2019. Entrevista a Álvaro Cuadra: Desnudando al príncipe posmoderno. Revista chilena de semiótica 15. 154–158.Search in Google Scholar

Djonov, Emilia & Theo van Leeuwen. 2017. The power of semiotic software: A critical multimodal perspective. In John Flowerdew & John E. Richardson (eds.), The Routledge handbook of critical discourse studies, 566–581. London: Routledge.10.4324/9781315739342-39Search in Google Scholar

Er, Ibrahim. 2020. The voiceless in the voice: A multimodal critical discourse analysis. Text & Talk 40(6). 705–732. https://doi.org/10.1515/text-2020-2071.Search in Google Scholar

Fabbri, Paolo. 2000. El giro semiótico. Barcelona: Editorial Gedisa.Search in Google Scholar

Gutiérrez Miranda, Martha. 2017. Semiótica y tecnología: La interfaz icónica y el signo interactivo. No solo usabilidad, revista sobre personas, diseño y tecnología 16. 10–17.Search in Google Scholar

Halliday, Michael. 2014. Language as social semiotic. In Johannes Angermuller, Dominique Maingueneau & Wodak Ruth (eds.), The discourse studies reader, 263–272. Amsterdam: John Benjamins.10.1075/z.184.52halSearch in Google Scholar

Hartley, John, Indrek Ibrus & Maarja Ojamaa. 2020. On the digital semiosphere: Culture, media and science for the anthropocene. London: Bloomsbury.10.5040/9781501369209Search in Google Scholar

Hegedus, Stephen John & Luis Moreno-Armella. 2011. The emergence of mathematical structures. Educational Studies in Mathematics 77(2–3). 369–388. https://doi.org/10.1007/s10649-010-9297-7.Search in Google Scholar

Jafari, Majid Rahimi & Tajbakhsh Fanaeian. 2015. A semiotics study of dramatic aspects in Ta’zieh and tragedy: An analogic and digital semiotics approach. Language Related Research 6(3). 93–114.Search in Google Scholar

Jensen, Klaus Bruhn. 1997. La semiótica social de la comunicación de masas. Barcelona: Bosch.Search in Google Scholar

Kress, Gunther. 2010. Multimodality: A social semiotic approach to contemporary communication. London: Routledge.Search in Google Scholar

Kress, Gunther & Theo van Leeuwen. 2001. Multimodal discourse: The modes and media of contemporary communication. New York: Hodder Arnold.Search in Google Scholar

Khanwalkar, Seema. 2017. Humanities in the digital world/or digital in the humanities? The American Journal of Semiotics 33. 69–82. https://doi.org/10.5840/ajs201721521.Search in Google Scholar

Kilstrup, Mogens. 2012. Duality. In Donald Favareau, Cobley Paul & Kalevi Kulls (eds.), A more developed sign, vol. 10, 107–110. Tartu: University of Tartu.Search in Google Scholar

Kucuk, S. Umit. 2015. A semiotic analysis of consumer-generated antibranding. Marketing Theory 15(2). 243–264. https://doi.org/10.1177/1470593114540677.Search in Google Scholar

Londoño, Julio César. 1992. Sacrificio de Dama (cuento ganador del concurso de ciencia ficción de La Ciencia y el Hombre). https://cdigital.uv.mx/handle/123456789/5137 (accessed 30 May 2020).Search in Google Scholar

Lotman, Iurii Mikhailovich. 2000. La semiosfera III. Semiótica de las artes y la cultura. Madrid: Cátedra.Search in Google Scholar

Manovich, Lev. 2002. The language of new media. Cambridge, Mass: The MIT Press.10.22230/cjc.2002v27n1a1280Search in Google Scholar

Moher, David, Larissa Shamseer, Mike Clarke, Davina Ghersi, Alessandro Liberati, Mark Petticrew & Lesley A. Stewart. 2016. Ítems de referencia para publicar protocolos de revisiones sistemáticas y metaanálisis: Declaración PRISMA-P 2015. Revista Española de Nutrición Humana y Dietética 20(2). 148–160. https://doi.org/10.14306/renhyd.20.2.223.Search in Google Scholar

Monteiro, Silvana Drumond & María Aparecida Moura. 2014. Knowledge graph and semantization in cyberspace: A study of contemporary indexes. Knowledge Organization 41(6). 429–439. https://doi.org/10.5771/0943-7444-2014-6-429.Search in Google Scholar

Morris, Charles. 2014. Writings on the general theory of signs. Berlin: De Gruyter Mouton.Search in Google Scholar

Nantke, Julia. 2017. Approaches to digital semiotics: Between computer-aided semiotics and semiotics as meta-discipline of digital literary studies. Zeitschrift Fur Semiotik 39(1–2). 83–108.Search in Google Scholar

O’Halloran, Kay L., K.L.E. Marissa, Alexei Podlasov & Sabine Tan. 2013. Multimodal digital semiotics: The interaction of language with other resources. Text & Talk 33(4–5). 665–690.10.1515/text-2013-0030Search in Google Scholar

O’Halloran, Kay L. 2012. Análisis del discurso multimodal. Revista latinoamericana de estudios del discurso 12(1). 75–97. https://doi.org/10.35956/v.12.n1.2012.p.75-97.Search in Google Scholar

O’Halloran, Kay L. 2015. Multimodal digital humanities. In: International handbook of semiotics, 389–415. Dordrecht: Springer.10.1007/978-94-017-9404-6_18Search in Google Scholar

O’Halloran, Kay L., Sabine Tan, Duc-Son Pham, John A. Bateman & Andrew Vande Moere. 2018. A digital mixed methods research design: Integrating multimodal analysis with data mining and information visualization for big data analytics. Journal of Mixed Methods Research 12(1). 11–30. https://doi.org/10.1177/1558689816651015.Search in Google Scholar

O’Halloran, Kay L., Sabine Tan, Peter Wignell, Jhon A. Bateman, Duc-Son Pham, Michele Grossman & Andrew Van de Moere. 2019. Interpreting text and image relations in violent extremist discourse: A mixed methods approach for big data analytics. Terrorism and Political Violence 31(3). 454–474. https://doi.org/10.1080/09546553.2016.1233871.Search in Google Scholar

Pérez-Escoda. 2017. WOS y Scopus: Los grandes aliados de todo investigador. Escuela de autores. Revista Comunicar. https://doi.org/10.3916/escuela-de-autores-031.Search in Google Scholar

Podlasov, Alexei, Sabine Tan & Kay L. O’Halloran. 2012. Interactive state-transition diagrams for visualization of multimodal annotation. Intelligent Data Analysis 16(4). 683–702. https://doi.org/10.3233/ida-2012-0544.Search in Google Scholar

Poulsen, Søren Vigild & Gunhild Kvåle. 2018. Studying social media as semiotic technology: A social semiotic multimodal framework. Social Semiotics 28(5). 700–717. https://doi.org/10.1080/10350330.2018.1505689.Search in Google Scholar

Pujol, Rosa. 1995. La literatura gris en expansión. El profesional de la información. http://profesionaldelainformacion.com/contenidos/1995/marzo/la_literatura_gris_en_expansin.html (accessed 20 May 2020).Search in Google Scholar

Reyes, Everardo. 2015. Espaces web pour une sémiotique visuelle numérique. CASA: Cadernos de semiótica aplicada 13(2). 145–184. https://doi.org/10.21709/casa.v13i2.7899.Search in Google Scholar

Reyes, Everardo & Göran Sonesson. 2019. New approaches to plastic language: Prolegomena to a computer-aided approach to pictorial semiotics. Semiotica 230. 71–95. https://doi.org/10.1515/sem-2018-0106.Search in Google Scholar

Sadek, Fodil Mohammed. 2017. Compositional writing to cope with electronic media. In Marcelo Sampaio (ed.), Communication, management and information technology: International conference on communication, management and information technology (ICCMIT 2016), 125–130. Cosenza: Taylor & Francis.Search in Google Scholar

Sánchez, Julio & Juan Botella. 2010. Revisiones sistemáticas y meta-análisis: Herramientas para la práctica profesional. Papeles del Psicólogo 31(1). 7–17.Search in Google Scholar

Scolari, Carlos. 2008. Hipermediaciones: Elementos para una teoría de la comunicación digital interactiva. Barcelona: Gedisa.Search in Google Scholar

Scolari, Carlos. 2013. Narrativas transmedia. Cuando todos los medios cuentan. Barcelona: Deusto.Search in Google Scholar

Scolari, Carlos. 2015. Los ecos de McLuhan: Ecología de los medios, semiótica e interfaces. Palabra Clave 18(3). 1025–1056. https://doi.org/10.5294/pacla.2015.18.4.4.Search in Google Scholar

Scolari, Carlos. 2018. The interactive syntax: Contributions of semiotics to a theory of social interaction. Razón y Palabra 22(1–100). 673–690.Search in Google Scholar

Sorókina, Tatiana. 2004. La semiótica, la escritura virtual y las permutas educacionales. Revista Iberoamericana de educación 33(3). 1–6.Search in Google Scholar

Velásquez, Blanca, Mauricio Pineda & Yesid Hernández. 2007. Abiectum: A study of the abject as a view in the contemporary photography. Revista Científica 9. 11–28.10.14483/23448350.351Search in Google Scholar

Vidaure-Arenas, Carmen. 2020. La cámara sangrienta: Transtextualidad y transmedialidad en el libro ilustrado. Signa: Revista de la Asociación Española de Semiótica 29. 875–902. https://doi.org/10.5944/signa.vol29.2020.23521.Search in Google Scholar

Wagener, Albin. 2020. Hypernarrativity, storytelling, and the relativity of truth: Digital semiotics of communication and interaction. Postdigital Science and Education 2. 147–169. https://doi.org/10.1007/s42438-019-00066-7.Search in Google Scholar

Wiggins, Bradley E. 2020. Boogaloo and civil war 2: Memetic antagonism in expressions of covert activism. New Media & Society 20. 1–27.10.1177/1461444820945317Search in Google Scholar

Wiggins, Bradley E. 2019. The discursive power of memes in digital culture: Ideology, semiotics, and intertextuality. New York: Routledge.10.4324/9780429492303Search in Google Scholar

Wildfeuer, Janina. 2019. The inferential semantics of comics: Panels and their meanings. Poetics Today 40(2). 215–234. https://doi.org/10.1215/03335372-7298522.Search in Google Scholar

Received: 2021-06-07
Accepted: 2022-09-06
Published Online: 2022-09-21
Published in Print: 2024-01-29

© 2022 Walter de Gruyter GmbH, Berlin/Boston

Downloaded on 25.4.2024 from https://www.degruyter.com/document/doi/10.1515/text-2021-0073/html
Scroll to top button