Vibhor Agarwal
Nishanth Sastry
ABSTRACT
Online forums that allow participatory engagement between users have been transformative for public discussion of important issues. However, debates on such forums can sometimes escalate into full blown exchanges of hate or misinformation. An important tool in understanding and tackling such problems is to be able to infer the argumentative relation of whether a reply is supporting or attacking the post it is replying to. This so called polarity prediction task is difficult because replies may be based on external context beyond a post and the reply whose polarity is being predicted. We propose GraphNLI, a novel graph-based deep learning architecture that uses graph walk techniques to capture the wider context of a discussion thread in a principled fashion. Specifically, we propose methods to perform root-seeking graph walks that start from a post and captures its surrounding context to generate additional embeddings for the post. We then use these embeddings to predict the polarity relation between a reply and the post it is replying to. We evaluate the performance of our models on a curated debate dataset from Kialo, an online debating platform. Our model outperforms relevant baselines, including S-BERT, with an overall accuracy of 83%.
- Pushkal Agarwal, Oliver Hawkins, Margarita Amaxopoulou, Noel Dempsey, Nishanth Sastry, and Edward Wood. 2021. Hate Speech in Political Discourse: A Case Study of UK MPs on Twitter. In Proceedings of the 32nd ACM Conference on Hypertext and Social Media (Virtual Event, USA) (HT ’21). Association for Computing Machinery, New York, NY, USA, 5–16. https://doi.org/10.1145/3465336.3475113Google Scholar
Digital Library
- Pushkal Agarwal, Sagar Joglekar, Panagiotis Papadapoulos, Nishanth Sastry, and Nicolas Kourtellis. 2020. Stop tracking me Bro! Differential Tracking of User Demographics on Hyper-Partisan Websites. In Proceedings of the The Web Conference (WWW 2020)(WWW ’20). International World Wide Web Conferences Steering Committee, Taipei, Taiwan, 10 pages.Google ScholarDigital Library
- Vibhor Agarwal, Yash Vekaria, Pushkal Agarwal, Sangeeta Mahapatra, Shounak Set, Sakthi Balan Muthiah, Nishanth Sastry, and Nicolas Kourtellis. 2021. Under the Spotlight: Web Tracking in Indian Partisan News Websites. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 15. 26–37.Google ScholarCross Ref
- Hunt Allcott and Matthew Gentzkow. 2017. Social media and fake news in the 2016 election. Journal of Economic Perspectives 31, 2 (2017), 211–36.Google ScholarCross Ref
- Christopher A. Bail, Lisa P. Argyle, Taylor W. Brown, John P. Bumpus, Haohan Chen, M. B. Fallin Hunzaker, Jaemin Lee, Marcus Mann, Friedolin Merhout, and Alexander Volfovsky. 2018. Exposure to opposing views on social media can increase political polarization. Proceedings of the National Academy of Sciences 115, 37(2018), 9216–9221.Google ScholarCross Ref
- Pietro Baroni, Martin Caminada, and Massimiliano Giacomin. 2011. An introduction to argumentation semantics. The Knowledge Engineering Review 26, 4 (2011), 365–410.Google ScholarDigital Library
- Shweta Bhatt, Sagar Joglekar, Shehar Bano, and Nishanth Sastry. 2018. Illuminating an Ecosystem of Partisan Websites. In Companion Proceedings of the The Web Conference 2018 (Lyon, France) (WWW ’18). International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, Switzerland, 545–554. https://doi.org/10.1145/3184558.3188725Google ScholarDigital Library
- Johan Bos and Katja Markert. 2006. When logical inference helps determining textual entailment (and when it doesn’t). In Proceedings of the Second PASCAL RTE challenge. 26.Google Scholar
- Tom Bosc, Elena Cabrio, and Serena Villata. 2016. Tweeties Squabbling: Positive and Negative Results in Applying Argument Mining on Social Media.6th International Conference on Computational Models of Argument 2016 (2016), 21–32.Google Scholar
- Gioia Boschi, Anthony P. Young, Sagar Joglekar, Chiara Cammarota, and Nishanth Sastry. 2021. Who Has the Last Word? Understanding How to Sample Online Discussions. ACM Transactions on the Web (TWEB) 15, 3 (2021), 1–25.Google ScholarDigital Library
- Elena Cabrio and Serena Villata. 2013. A natural language bipolar argumentation approach to support users in online debate interactions. Argument & Computation 4, 3 (2013), 209–230.Google ScholarCross Ref
- Elena Cabrio and Serena Villata. 2018. Five Years of Argument Mining: a Data-driven Analysis.. In IJCAI, Vol. 18. 5427–5433.Google Scholar
- Claudette Cayrol and Marie-Christine Lagasquie-Schiex. 2005. On the Acceptability of Arguments in Bipolar Argumentation Frameworks. In European Conference on Symbolic and Quantitative Approaches to Reasoning and Uncertainty. Springer, 378–389.Google Scholar
- Claudette Cayrol and Marie-Christine Lagasquie-Schiex. 2013. Bipolarity in Argumentation Graphs: Towards a Better Understanding. International Journal of Approximate Reasoning 54, 7 (2013), 876–899.Google ScholarCross Ref
- Matteo Cinelli, Andraž Pelicon, Igor Mozetič, Walter Quattrociocchi, Petra Kralj Novak, and Fabiana Zollo. 2021. Online Hate: Behavioural Dynamics and Relationship with Misinformation. arXiv preprint arXiv:2105.14005(2021).Google Scholar
- Oana Cocarascu, Elena Cabrio, Serena Villata, and Francesca Toni. 2020. A dataset independent set of baselines for relation prediction in argument mining. arXiv preprint arXiv:2003.04970(2020).Google Scholar
- Oana Cocarascu and Francesca Toni. 2017. Identifying attack and support argumentative relations using deep learning. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. 1374–1379.Google ScholarCross Ref
- Ido Dagan, Bill Dolan, Bernardo Magnini, and Dan Roth. 2010. Recognizing textual entailment: Rational, evaluation and approaches–erratum. Natural Language Engineering 16, 1 (2010), 105–105.Google ScholarCross Ref
- Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805(2018).Google Scholar
- Phan Minh Dung. 1995. On the Acceptability of Arguments and its Fundamental Role in Nonmonotonic Reasoning, Logic Programming and n-Person Games. Artificial Intelligence 77, 2 (1995), 321–357.Google ScholarDigital Library
- Iginio Gagliardone, Danit Gal, Thiago Alves, and Gabriela Martinez. 2015. Countering online hate speech. UNESCO Publishing.Google Scholar
- Kiran Garimella, Gianmarco De Francisci Morales, Aristides Gionis, and Michael Mathioudakis. 2017. Reducing controversy by connecting opposing views. In Proceedings of the Tenth ACM International Conference on Web Search and Data Mining. 81–90.Google ScholarDigital Library
- Ella Guest, Bertie Vidgen, Alexandros Mittos, Nishanth Sastry, Gareth Tyson, and Helen Margetts. 2021. An Expert Annotated Dataset for the Detection of Online Misogyny. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume. 1336–1350.Google ScholarCross Ref
- Andreas Hanselowski, PVS Avinesh, Benjamin Schiller, Felix Caspelherr, Debanjan Chaudhuri, Christian M Meyer, and Iryna Gurevych. 2018. A Retrospective Analysis of the Fake News Challenge Stance-Detection Task. In Proceedings of the 27th International Conference on Computational Linguistics. 1859–1874.Google Scholar
- Twitter Inc.2022. Healthy conversations. https://about.twitter.com/en/our-priorities/healthy-conversationsGoogle Scholar
- Sagar Joglekar, Nishanth Sastry, Neil S Coulson, Stephanie JC Taylor, Anita Patel, Robbie Duschinsky, Amrutha Anand, Matt Jameson Evans, Chris J Griffiths, Aziz Sheikh, 2018. How online communities of people with long-term conditions function and evolve: network analysis of the structure and dynamics of the asthma UK and British lung foundation online communities. Journal of Medical Internet Research 20, 7 (2018), e238.Google ScholarCross Ref
- Dmytro Karamshuk, Tetyana Lokot, Oleksandr Pryymak, and Nishanth Sastry. 2016. Identifying Partisan Slant in News Articles and Twitter During Political Crises. In Social Informatics, Emma Spiro and Yong-Yeol Ahn (Eds.). Springer International Publishing, Cham, 257–272.Google Scholar
- Sebastian Köffer, Dennis M Riehle, Steffen Höhenberger, and Jörg Becker. 2018. Discussing the value of automatic hate speech detection in online debates. Multikonferenz Wirtschaftsinformatik (MKWI 2018): Data Driven X-Turning Data in Value, Leuphana, Germany(2018).Google Scholar
- Milen Kouylekov and Matteo Negri. 2010. An open-source package for recognizing textual entailment. In Proceedings of the ACL 2010 System Demonstrations. 42–47.Google ScholarDigital Library
- Srijan Kumar, Robert West, and Jure Leskovec. 2016. Disinformation on the web: Impact, characteristics, and detection of wikipedia hoaxes. In Proceedings of the 25th international conference on World Wide Web. 591–602.Google ScholarDigital Library
- John Lawrence and Chris Reed. 2020. Argument Mining: A Survey. Computational Linguistics 45, 4 (2020), 765–818.Google ScholarDigital Library
- Marco Lippi and Paolo Torroni. 2016. Argumentation Mining: State of the Art and Emerging Trends. ACM Transactions on Internet Technology (TOIT) 16, 2 (2016), 1–25.Google ScholarDigital Library
- Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. RoBERTa: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692(2019).Google Scholar
- Tobias Mayer, Santiago Marro, Elena Cabrio, and Serena Villata. 2021. Enhancing Evidence-Based Medicine with Natural Language Argumentative Analysis of Clinical Trials. Artificial Intelligence in Medicine(2021), 102098.Google Scholar
- Pietro Panzarasa, Christopher J Griffiths, Nishanth Sastry, and Anna De Simoni. 2020. Social medical capital: how patients and caregivers can benefit from online social interactions. Journal of Medical Internet Research 22, 7 (2020), e16337.Google ScholarCross Ref
- Iyad Rahwan, Mohammed I Madakkatel, Jean-François Bonnefon, Ruqiyabi N Awan, and Sherief Abdallah. 2010. Behavioral experiments for assessing the abstract argumentation semantics of reinstatement. Cognitive Science 34, 8 (2010), 1483–1502.Google ScholarCross Ref
- Iyad Rahwan and Guillermo R. Simari. 2009. Argumentation in Artificial Intelligence. Vol. 47. Springer.Google Scholar
- Nils Reimers and Iryna Gurevych. 2019. Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing.Google ScholarCross Ref
- Serena Villata. 2021. Towards assessing natural language argument strength: results and open challenges. http://argstrength2021.argumentationcompetition.org/Google Scholar
- Anthony P. Young. 2018. Notes on Abstract Argumentation Theory. arXiv preprint arXiv:1806.07709(2018).Google Scholar
- Anthony P. Young. 2021. Likes as Argument Strength for Online Debates. In The Third Workshop on Argument Strength. Available from http://argstrength2021.argumentationcompetition.org/papers/ArgStrength2021_paper_8.pdf, last accessed 22/1/2022.Google Scholar
- Anthony P. Young, Sagar Joglekar, Gioia Boschi, and Nishanth Sastry. 2021. Ranking comment sorting policies in online debates. Argument & Computation 12, 2 (2021), 265–285.Google ScholarCross Ref
- Anthony P. Young, Sagar Joglekar, Kiran Garimella, and Nishanth Sastry. 2018. Approximations to truth in online comment networks. In The Workshop on Argumentation and Society at the 7th International Conference on Computational Models of Argument. Available from https://nishrs.github.io/publication/young-2018-comma/, last accessed 22/1/2022.Google Scholar
- Justine Zhang, Arthur Spirling, and Cristian Danescu-Niculescu-Mizil. 2017. Asking too much? The rhetorical role of questions in political discourse. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. 1558–1572.Google ScholarCross Ref
Index Terms
- GraphNLI: A Graph-based Natural Language Inference Model for Polarity Prediction in Online Debates
Index terms have been assigned to the content through auto-classification.
Recommendations
Topic-Based Microblog Polarity Classification Based on Cascaded Model
Computational Science – ICCS 2018AbstractGiven a microblog post and a topic, it is an important task to judge the sentiment towards that topic: positive or negative, and has important theoretical and application value in the public opinion analysis, personalized recommendation, product ...
Stance polarity in political debates: A diachronic perspective of network homophily and conversations on Twitter
AbstractIn the last decade, social media gained a very significant role in public debates, and despite the many intrinsic difficulties of analyzing data streaming from on-line platforms that are poisoned by bots, trolls, and low-quality ...
Comments