skip to main content
research-article
Free Access
Just Accepted

Enhancing Coherence and Diversity in Multi-Class Slogan Generation Systems

Online AM:15 December 2023Publication History
Skip Abstract Section

Abstract

Many problems related to natural language processing are solved by neural networks and big data. Researchers have previously focused on single-task supervised goals with limited data management to train slogan classification. A multi-task learning framework is used to learn jointly across several tasks related to generating multi-class slogan types. This study proposes a multi-task model named slogan generative adversarial network systems (Slo-GAN) to enhance coherence and diversity in slogan generation, utilizing generative adversarial networks and recurrent neural networks (RNN). Slo-GAN generates a new text slogan-type corpus, and the training generalization process is improved. We explored active learning (AL) and meta-learning (ML) for dataset labeling efficiency. AL reduced annotations by 10% compared to ML but still needed about 70% of the full dataset for baseline performance. The whole framework of Slo-GAN is supervised and trained together on all of these tasks. The text with the higher reporting score level is filtered by Slo-GAN, and a classification accuracy of 87.2% is achieved. We leveraged relevant datasets to perform a cross-domain experiment, reinforcing our assertions regarding both the distinctiveness of our dataset and the challenges of adapting bilingual dialects to one another.

References

  1. Somayeh Abdi and Abdollah Irandoust. 2013. The importance of advertising slogans and their proper designing in brand equity. International journal of Organizational leadership 2, 2 (2013), 62–69.Google ScholarGoogle ScholarCross RefCross Ref
  2. Pir Noman Ahmad, Yuanchao Liu, Gauhar Ali, Mudasir Ahmad Wani, and Mohammed ElAffendi. 2023. Robust Benchmark for Propagandist Text Detection and Mining High-Quality Data. Mathematics 11, 12 (2023), 2668. https://doi.org/10.3390/math11122668Google ScholarGoogle ScholarCross RefCross Ref
  3. Pir Noman Ahmad, Yuanchao Liu, Khalid Khan, Tao Jiang, and Umama Burhan. 2023. BIR: Biomedical Information Retrieval System for Cancer Treatment in Electronic Health Record Using Transformers. Sensors 23, 23 (2023), 9355.Google ScholarGoogle ScholarCross RefCross Ref
  4. Abdullah Saleh Alqahtani, P. Saravanan, M. Maheswari, and Sami Alshmrany. 2022. An automatic query expansion based on hybrid CMO-COOT algorithm for optimized information retrieval. J Supercomput 78, 6 (2022), 8625–8643. https://doi.org/10.1007/s11227-021-04171-yGoogle ScholarGoogle ScholarDigital LibraryDigital Library
  5. Shizhe Diao, Xinwei Shen, Kashun Shum, Yan Song, and Tong Zhang. 2021. TILGAN: Transformer-based implicit latent GAN for diverse and coherent text generation. In Findings of the Association for Computational Linguistics: ACL-IJCNLP, 4844–4858 (2021).Google ScholarGoogle Scholar
  6. Mostaq Ahmed, Partha Chakraborty, and Tanupriya Choudhury. 2022. Bangla Document Categorization Using Deep RNN Model with Attention Mechanism. In Cyber Intelligence and Information Retrieval. Springer, 137–147.Google ScholarGoogle Scholar
  7. Huma Akhtar and Hamna Khalid. 2019. THE USE OF ENGLISH WORDS IN URDU MAGAZINE PRINT ADVERTISEMENTS: AN ANALYSIS. Bahria University Journal of Humanities & Social Sciences 2, 1 (2019), 14–14.Google ScholarGoogle Scholar
  8. Khalid Alnajjar, Hadaytullah Kundi, and Hannu Toivonen. 2018. “ Talent, Skill and Support.”: A Method for Automatic Creation of Slogans. In Proceedings of the Ninth International Conference on Computational Creativity, Salamanca, Spain, June 25-29, 2018, Association for Computational Creativity.Google ScholarGoogle Scholar
  9. Khalid Alnajjar and Hannu Toivonen. 2021. Computational generation of slogans. Natural Language Engineering 27, 5 (2021), 575–607.Google ScholarGoogle ScholarCross RefCross Ref
  10. Pir Noman Ahmad, Adnan Muhammad Shah, and KangYoon Lee. 2023. Propaganda Detection in Public Covid-19 Discussion on Social Media. (2023).Google ScholarGoogle Scholar
  11. Margaret M. Bradley and Peter J. Lang. 1999. Affective norms for English words (ANEW): Instruction manual and affective ratings. Technical report C-1, the center for research in psychophysiology.Google ScholarGoogle Scholar
  12. Xavier A. Carrasco, Ashraf Elnagar, and Mohammed Lataifeh. 2021. A Generative Adversarial Network for Data Augmentation: The Case of Arabic Regional Dialects. Procedia Computer Science 189, (2021), 92–99.Google ScholarGoogle Scholar
  13. Junfan Chen, Richong Zhang, Yongyi Mao, and Jie Xu. 2022. Contrastnet: A contrastive learning framework for few-shot text classification. In Proceedings of the AAAI Conference on Artificial Intelligence, 2022. 10492–10500.Google ScholarGoogle ScholarCross RefCross Ref
  14. WenShin Chen and Rudy Hirschheim. 2004. A paradigmatic and methodological examination of information systems research from 1991 to 2001. Information systems journal 14, 3 (2004), 197–235.Google ScholarGoogle Scholar
  15. Yizhou Chen, Xu-Hua Yang, Zihan Wei, Ali Asghar Heidari, Nenggan Zheng, Zhicheng Li, Huiling Chen, Haigen Hu, Qianwei Zhou, and Qiu Guan. 2022. Generative adversarial networks in medical image augmentation: a review. Computers in Biology and Medicine (2022), 105382.Google ScholarGoogle Scholar
  16. Yu-Fu Chen and Szu-Hao Huang. 2021. Sentiment-influenced trading system based on multimodal deep reinforcement learning. Applied Soft Computing 112, (2021), 107788.Google ScholarGoogle Scholar
  17. Kyunghyun Cho, Aaron Courville, and Yoshua Bengio. 2015. Describing multimedia content using attention-based encoder-decoder networks. IEEE Transactions on Multimedia 17, 11 (2015), 1875–1886.Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Francesca MM Citron, Brendan S. Weekes, and Evelyn C. Ferstl. 2014. How are affective word ratings related to lexicosemantic properties? Evidence from the Sussex Affective Word List. Applied Psycholinguistics 35, 2 (2014), 313–331.Google ScholarGoogle ScholarCross RefCross Ref
  19. Giovanni Da San Martino, Alberto Barrón-Cedeño, and Preslav Nakov. 2019. Findings of the NLP4IF-2019 Shared Task on Fine-Grained Propaganda Detection. In Proceedings of the Second Workshop on Natural Language Processing for Internet Freedom: Censorship, Disinformation, and Propaganda, November 2019, Hong Kong, China. Association for Computational Linguistics, Hong Kong, China, 162–170.. https://doi.org/10.18653/v1/D19-5024Google ScholarGoogle ScholarCross RefCross Ref
  20. Mayukh Dass, Chiranjeev Kohli, and Manaswini Acharya. 2023. An Investigation Into Slogan Design On Creating Slogan–Brand Alignment: Message Clarity and Creativity Enhance While Jingles and Rhymes Weaken Alignment. Journal of Advertising Research 63, 1 (2023), 43–60.Google ScholarGoogle ScholarCross RefCross Ref
  21. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), June 2019, Minneapolis, Minnesota. Association for Computational Linguistics, Minneapolis, Minnesota, 4171–4186.. https://doi.org/10.18653/v1/N19-1423Google ScholarGoogle ScholarCross RefCross Ref
  22. Pir Noman Ahmad, Adnan Muhammad Shah, and KangYoon Lee. 2023. A Review on Electronic Health Record Text-Mining for Biomedical Name Entity Recognition in Healthcare Domain. In Healthcare, 2023. MDPI, 1268.Google ScholarGoogle Scholar
  23. Tom Dobber, Nadia Metoui, Damian Trilling, Natali Helberger, and Claes de Vreese. 2021. Do (microtargeted) deepfakes have real effects on political attitudes? The International Journal of Press/Politics 26, 1 (2021), 69–91.Google ScholarGoogle Scholar
  24. Mateusz Dolata, Stefan Feuerriegel, and Gerhard Schwabe. 2022. A sociotechnical view of algorithmic fairness. Information Systems Journal 32, 4 (2022), 754–818.Google ScholarGoogle ScholarCross RefCross Ref
  25. Grahame R. Dowling and Boris Kabanoff. 1996. Computer-aided content analysis: what do 240 advertising slogans have in common? Marketing Letters 7, 1 (1996), 63–75.Google ScholarGoogle ScholarCross RefCross Ref
  26. [26] Tatjana Dubovičienė and Pavel Skorupa. 2014. The Analysis of some Stylistic Features of English Advertising Slogans. Man & the Word/Zmogus ir zodis 16, 3 (2014).Google ScholarGoogle Scholar
  27. Nima Ebadi, Mohsen Jozani, Kim-Kwang Raymond Choo, and Paul Rad. 2021. A memory network information retrieval model for identification of news misinformation. IEEE Transactions on Big Data (2021).Google ScholarGoogle Scholar
  28. Ashraf Elnagar, Ridhwan Al-Debsi, and Omar Einea. 2020. Arabic text classification using deep learning models. Information Processing & Management 57, 1 (2020), 102121.Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Mauajama Firdaus, Naveen Thangavelu, Asif Ekbal, and Pushpak Bhattacharyya. 2022. I enjoy writing and playing, do you: A Personalized and Emotion Grounded Dialogue Agent using Generative Adversarial Network. IEEE Transactions on Affective Computing, 14, 3 (2022), 2127-2138.Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Nuria Galí, Raquel Camprubí, and José A. Donaire. 2017. Analysing tourism slogans in top tourism destinations. Journal of Destination Marketing & Management 6, 3 (2017), 243–251.Google ScholarGoogle ScholarCross RefCross Ref
  31. Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative adversarial nets. Advances in neural information processing systems 27, (2014).Google ScholarGoogle Scholar
  32. Alex Graves and Jürgen Schmidhuber. 2005. Framewise phoneme classification with bidirectional LSTM and other neural network architectures. Neural networks 18, 5–6 (2005), 602–610.Google ScholarGoogle Scholar
  33. Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation 9, 8 (1997), 1735–1780.Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Lindsay Pérez Huber. 2016. Make America great again: Donald Trump, racist nativism and the virulent adherence to white supremecy amid US demographic change. Charleston L. Rev. 10, (2016), 215.Google ScholarGoogle Scholar
  35. Kango Iwama and Yoshinobu Kano. 2018. Japanese advertising slogan generator using case frame and word vector. In Proceedings of the 11th International Conference on Natural Language Generation, 2018. 197–198.Google ScholarGoogle ScholarCross RefCross Ref
  36. Soo-Yeon Jeong and Young-Kuk Kim. 2021. Deep learning-based context-aware recommender system considering contextual features. Applied Sciences 12, 1 (2021), 45.Google ScholarGoogle ScholarCross RefCross Ref
  37. Ziyun Jiao and Fuji Ren. 2021. WRGAN: Improvement of RelGAN with wasserstein loss for text generation. Electronics 10, 3 (2021), 275.Google ScholarGoogle ScholarCross RefCross Ref
  38. Boris Katz, Igor Kaplansky, Rebecca Schulman, and Ali Ibrahim. Information Retrieval using Patterns and Relations. MIT Artificial Intelligence Laboratory Research Abstracts, September 2000.Google ScholarGoogle Scholar
  39. Qunsheng Ke and Weiwei Wang. 2013. The Adjective Frequency in Advertising English Slogans. Theory & Practice in Language Studies 3, 2 (2013).Google ScholarGoogle Scholar
  40. Istvan Kecskes. 2006. On my mind: Thoughts about salience, context and figurative language from a second language perspective. Second Language Research 22, 2 (2006), 219–237.Google ScholarGoogle ScholarCross RefCross Ref
  41. Md Khan, Akib Zabed, Saif Mahmud Parvez, Md Rahman, and Md Musfique Anwar. 2021. Efficient Advertisement Slogan Detection and Classification Using a Hierarchical BERT and BiLSTM-BERT Ensemble Model. In International Conference on Intelligent Computing & Optimization, 2021. Springer, 964–975.Google ScholarGoogle ScholarCross RefCross Ref
  42. Gunhee Kim and Eric P. Xing. 2014. Reconstructing storyline graphs for image recommendation from web community photos. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2014. 3882–3889.Google ScholarGoogle Scholar
  43. Chiranjeev Kohli, Lance Leuthesser, and Rajneesh Suri. 2007. Got slogan? Guidelines for creating effective slogans. Business horizons 50, 5 (2007), 415–422.Google ScholarGoogle Scholar
  44. Yingying Liu, Peipei Li, and Xuegang Hu. 2022. Combining context-relevant features with multi-stage attention network for short text classification. Computer Speech & Language 71, (2022), 101268.Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692 (2019).Google ScholarGoogle Scholar
  46. Yong Liu and Xiangnan Gou. 2021. A Text Classification Method Based on Graph Attention Networks. In 2021 International Conference on Information Technology and Biomedical Engineering (ICITBE), 2021. IEEE, 35–39.Google ScholarGoogle ScholarCross RefCross Ref
  47. Gözde Özbal, Daniele Pighin, and Carlo Strapparava. 2013. Brainsup: Brainstorming support for creative sentence generation. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2013. 1446–1455.Google ScholarGoogle Scholar
  48. Steve Pan. 2019. Tourism slogans–Towards a conceptual framework. Tourism Management 72, (2019), 180–191.Google ScholarGoogle Scholar
  49. Steve Pan, Carla Santos, and Seongseop Kim. 2017. Promoting tourism, projecting power: The role of television commercials. Journal of Travel & Tourism Marketing 34, 2 (2017), 192–208.Google ScholarGoogle ScholarCross RefCross Ref
  50. Yingwei Pan, Tao Mei, Ting Yao, Houqiang Li, and Yong Rui. 2016. Jointly modeling embedding and translation to bridge video and language. In Proceedings of the IEEE conference on computer vision and pattern recognition, 2016. 4594–4602.Google ScholarGoogle ScholarCross RefCross Ref
  51. Xiao Pu, Lin Yuan, Jiaxu Leng, Tao Wu, and Xinbo Gao. 2023. Lexical knowledge enhanced text matching via distilled word sense disambiguation. Knowledge-Based Systems (2023), 110282.Google ScholarGoogle Scholar
  52. Israr Qureshi, Shan L. Pan, and Yingqin Zheng. 2021. Digital social innovation: An overview and research framework. Information Systems Journal 31, 5 (2021), 647–671.Google ScholarGoogle ScholarCross RefCross Ref
  53. Alexander M. Rush, Sumit Chopra, and Jason Weston. 2015. A neural attention model for abstractive sentence summarization. arXiv preprint arXiv:1509.00685 (2015).Google ScholarGoogle Scholar
  54. Omar Sharif and Mohammed Moshiul Hoque. 2019. Automatic detection of suspicious Bangla text using logistic regression. In International Conference on Intelligent Computing & Optimization, 2019. Springer, 581–590.Google ScholarGoogle Scholar
  55. Saeid Sheikhi. 2021. An effective fake news detection method using WOA-xgbTree algorithm and content-based features. Applied Soft Computing 109, (2021), 107559.Google ScholarGoogle Scholar
  56. Gunnar A. Sigurdsson, Xinlei Chen, and Abhinav Gupta. 2016. Learning visual storylines with skipping recurrent neural networks. In European Conference on Computer Vision, 2016. Springer, 71–88.Google ScholarGoogle ScholarCross RefCross Ref
  57. Angus Stevenson. 2010. Oxford dictionary of English. Oxford University Press, USA.Google ScholarGoogle Scholar
  58. Carlo Strapparava, Alessandro Valitutti, and Oliviero Stock. 2007. Automatizing two creative functions for advertising. In Proceedings of the 4th International Joint Workshop on Computational Creativity, 2007. 99–108.Google ScholarGoogle Scholar
  59. Jing Su, Qingyun Dai, Frank Guerin, and Mian Zhou. 2021. BERT-hLSTMs: BERT and hierarchical LSTMs for visual storytelling. Computer Speech & Language 67, (2021), 101169.Google ScholarGoogle ScholarCross RefCross Ref
  60. Ilya Sutskever, James Martens, and Geoffrey E. Hinton. 2011. Generating text with recurrent neural networks. In ICML, 2011.Google ScholarGoogle Scholar
  61. Yoad Tewel, Yoav Shalev, Idan Schwartz, and Lior Wolf. 2022. ZeroCap: Zero-Shot Image-to-Text Generation for Visual-Semantic Arithmetic. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022. 17918–17928.Google ScholarGoogle ScholarCross RefCross Ref
  62. Andros Tjandra, Sakriani Sakti, Ruli Manurung, Mirna Adriani, and Satoshi Nakamura. 2016. Gated recurrent neural tensor network. In 2016 International Joint Conference on Neural Networks (IJCNN), 2016. IEEE, 448–455.Google ScholarGoogle ScholarCross RefCross Ref
  63. Polona Tomašic, M. Znidaršic, and Gregor Papa. 2014. Implementation of a slogan generator. In Proceedings of 5th International Conference on Computational Creativity, Ljubljana, Slovenia, 2014. 340–343.Google ScholarGoogle Scholar
  64. Polyxeni Vassilakopoulou and Eli Hustad. 2023. Bridging digital divides: a literature review and research agenda for information systems research. Information Systems Frontiers 25, 3 (2023), 955–969.Google ScholarGoogle ScholarDigital LibraryDigital Library
  65. Tony Veale and Guofu Li. 2013. Creating similarity: Lateral thinking for vertical similarity judgments. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2013. 660–670.Google ScholarGoogle Scholar
  66. Subhashini Venugopalan, Marcus Rohrbach, Jeffrey Donahue, Raymond Mooney, Trevor Darrell, and Kate Saenko. 2015. Sequence to sequence-video to text. In Proceedings of the IEEE international conference on computer vision, 2015. 4534–4542.Google ScholarGoogle ScholarDigital LibraryDigital Library
  67. Hiroaki Yamane and Masafumi Hagiwara. 2015. Advertising slogan generation system reflecting user preference on the web. In Proceedings of the 2015 IEEE 9th International Conference on Semantic Computing (IEEE ICSC 2015), 2015. IEEE, 358–364.Google ScholarGoogle ScholarCross RefCross Ref
  68. Rui Yang, Pan Zhang, and YongGe Niu. 2018. The effect of tourism slogan message appeals on attitude toward slogan and travel intention: based on the perspective of mental imagery processing theory. Tourism Tribune 33, 6 (2018), 73–86.Google ScholarGoogle Scholar
  69. Ming Yuan and Jiangtao Ren. 2021. Numerical Feature Transformation-based Sequence Generation Model for Multi-disease Diagnosis. International Journal of Pattern Recognition and Artificial Intelligence 35, 10 (2021), 2159034.Google ScholarGoogle ScholarCross RefCross Ref
  70. Roman Zeiss, Anne Ixmeier, Jan Recker, and Johann Kranz. 2021. Mobilising information systems scholarship for a circular economy: Review, synthesis, and directions for future research. Information Systems Journal 31, 1 (2021), 148–183.Google ScholarGoogle ScholarCross RefCross Ref
  71. Yuqi Zhang, Bin Guo, Yasan Ding, Jiaqi Liu, Chen Qiu, Sicong Liu, and Zhiwen Yu. 2022. Investigation of the determinants for misinformation correction effectiveness on social media during COVID-19 pandemic. Information Processing & Management 59, 3 (2022), 102935.Google ScholarGoogle ScholarDigital LibraryDigital Library
  72. Ahmad Zuhdi, Cecep Suryana, Rodon Pedrason, Satryo Sasono, and Ahmad Musabiq Habibie. 2023. Digital Campaign: Character Branding and Framing towards the 2024 Presidential Election. Al Qalam: Jurnal Ilmiah Keagamaan dan Kemasyarakatan 17, 1 (2023), 195–208.Google ScholarGoogle Scholar

Index Terms

  1. Enhancing Coherence and Diversity in Multi-Class Slogan Generation Systems
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image ACM Transactions on Asian and Low-Resource Language Information Processing
          ACM Transactions on Asian and Low-Resource Language Information Processing Just Accepted
          ISSN:2375-4699
          EISSN:2375-4702
          Table of Contents

          Copyright © 2023 Copyright held by the owner/author(s). Publication rights licensed to ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Online AM: 15 December 2023
          • Accepted: 12 December 2023
          • Revised: 10 November 2023
          • Received: 20 September 2023
          Published in tallip Just Accepted

          Check for updates

          Qualifiers

          • research-article
        • Article Metrics

          • Downloads (Last 12 months)163
          • Downloads (Last 6 weeks)36

          Other Metrics

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader