skip to main content
research-article
Free Access
Just Accepted

Explainable Deep Attention Active Learning for Sentimental Analytics of Mental Disorder

Online AM:27 July 2022Publication History
Skip Abstract Section

Abstract

With the increasing use of online mediums, Internet-delivered psychological treatments (IDPs) are becoming an essential tool for improving mental disorders. Online-based health therapies can help a large segment of the population with little resource investment. The task is greatly complicated by the overlapping emotions for specific mental health. Early adoption of a deep learning system presented severe difficulties, including ethical and legal considerations that contributed to a lack of trust. Modern models required highly interpretable, intuitive explanations that humans could understand. To achieve this, we present a deep attention model based on fuzzy classification that uses the linguistic features of patient texts to build emotional lexicons. In medical applications, a diversified dataset generates work. Active learning techniques are used to extend fuzzy rules and the learned dataset gradually. From this, the model can gain a reduction in labeling efforts in mental health applications. In this way, difficulties such as the amount of vocabulary per class, method of generation, the source of data, and the baseline for human performance level can be solved. Moreover, this work illustrates fuzzy explainability by using weighted terms. The proposed method incorporates a subset of unstructured data into the set for training and uses a similarity-based approach. The approach then updates the model training using the new training points in the subsequent cycle of the active learning mechanism. The cycle is repeated until the optimal solution is found. At this point, all unlabeled text is converted into the set for training. The experimental results show that the emotion-based enhancement improves test accuracy and helps develop quality criteria. In the blind test, the bidirectional LSTM architecture with an attention mechanism and fuzzy classification achieved an F1 score of 0.89.

References

  1. Juan Aguilera, Delia Irazú Hernández Farías, Rosa María Ortega-Mendoza, and Manuel Montes-y Gómez. 2021. Depression and anorexia detection in social media as a one-class classification problem. Applied Intelligence(2021), 1–16.Google ScholarGoogle Scholar
  2. Usman Ahmed, Muhammad Aleem, Yasir Noman Khalid, Muhammad Arshad Islam, and Muhammad Azhar Iqbal. 2019. RALB-HC: A resource-aware load balancer for heterogeneous cluster. Concurrency and Computation: Practice and Experience (2019), e5606.Google ScholarGoogle Scholar
  3. Usman Ahmed, Jerry Chun-Wei Lin*, and Gautam Srivastava. 2022. Fuzzy Contrast Set Based Deep Attention Network for Lexical Analysis and Mental Health Treatment. Transactions on Asian and Low-Resource Language Information Processing (2022).Google ScholarGoogle Scholar
  4. Usman Ahmed, Jerry Chun Wei Lin, Gautam Srivastava, and Muhammad Aleem. 2020. A load balance multi-scheduling model for OpenCL kernel tasks in an integrated cluster. Soft Computing (2020), 1–14.Google ScholarGoogle Scholar
  5. KS Arikumar, Sahaya Beni Prathiba, Mamoun Alazab, Thippa Reddy Gadekallu, Sharnil Pandya, Javed Masood Khan, and Rajalakshmi Shenbaga Moorthy. 2022. FL-PMI: federated learning-based person movement identification through wearable devices in smart healthcare systems. Sensors 22, 4 (2022), 1377.Google ScholarGoogle ScholarCross RefCross Ref
  6. Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015. Neural machine translation by jointly learning to align and translate. In The International Conference on Learning Representations, Yoshua Bengio and Yann LeCun (Eds.). ICLR, 24–34.Google ScholarGoogle Scholar
  7. Xiangyi Chen, Steven Z Wu, and Mingyi Hong. 2020. Understanding gradient clipping in private SGD: A geometric perspective. Advances in Neural Information Processing Systems 33 (2020), 1–10.Google ScholarGoogle Scholar
  8. Edward Choi, Mohammad Taha Bahadori, Andy Schuetz, Walter F Stewart, and Jimeng Sun. 2016. Doctor ai: Predicting clinical events via recurrent neural networks. In Machine learning for healthcare conference. 301–318.Google ScholarGoogle Scholar
  9. Palash Dutta and Soumendra Goala. 2018. Fuzzy decision making in medical diagnosis using an advanced distance measure on intuitionistic fuzzy sets. The Open Cybernetics & Systemics Journal 12, 1 (2018).Google ScholarGoogle ScholarCross RefCross Ref
  10. Robin C Feldman, Ehrik Aldana, and Kara Stein. 2019. Artificial intelligence in the health care space: how we can trust what we cannot know. Stan. L. & Pol’y Rev. 30 (2019), 399.Google ScholarGoogle Scholar
  11. Jiří Filip and Tomáš Kliegr. 2018. Classification based on Associations (CBA)-a performance analysis. Technical Report. EasyChair.Google ScholarGoogle Scholar
  12. Xiaoqing Gu, Kaijian Xia, Yizhang Jiang, and Alireza Jolfaei. 2021. Multi-task Fuzzy Clustering–Based Multi-task TSK Fuzzy System for Text Sentiment Classification. Transactions on Asian and Low-Resource Language Information Processing 21, 2(2021), 1–24.Google ScholarGoogle Scholar
  13. David Gunning. 2017. Explainable artificial intelligence (xai). Defense Advanced Research Projects Agency (DARPA), nd Web 2, 2(2017).Google ScholarGoogle Scholar
  14. Alex Holub, Pietro Perona, and Michael C Burl. 2008. Entropy-based active learning for object recognition. In IEEE Conference on Computer Vision and Pattern Recognition Workshops. 1–8.Google ScholarGoogle ScholarCross RefCross Ref
  15. Andreas Holzinger, Georg Langs, Helmut Denk, Kurt Zatloukal, and Heimo Müller. 2019. Causability and explainability of artificial intelligence in medicine. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery 9, 4(2019), e1312.Google ScholarGoogle ScholarCross RefCross Ref
  16. Nasir Jamal, Chen Xianqiao, Fadi Al-Turjman, and Farhan Ullah. 2021. A Deep Learning–based Approach for Emotions Classification in Big Corpus of Imbalanced Tweets. Transactions on Asian and Low-Resource Language Information Processing 20, 3(2021), 1–16.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Kipp W Johnson, Jessica Torres Soto, Benjamin S Glicksberg, Khader Shameer, Riccardo Miotto, Mohsin Ali, Euan Ashley, and Joel T Dudley. 2018. Artificial intelligence in cardiology. Journal of the American College of Cardiology 71, 23(2018), 2668–2679.Google ScholarGoogle ScholarCross RefCross Ref
  18. Christian Karmen, Robert C. Hsiung, and Thomas Wetter. 2015. Screening Internet forum participants for depression symptoms by assembling and enhancing multiple NLP methods. Computer Methods and Programs in Biomedicine 120, 1(2015), 27–36.Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980(2014).Google ScholarGoogle Scholar
  20. Chayakrit Krittanawong, HongJu Zhang, Zhen Wang, Mehmet Aydar, and Takeshi Kitai. 2017. Artificial intelligence in precision cardiovascular medicine. Journal of the American College of Cardiology 69, 21(2017), 2657–2664.Google ScholarGoogle ScholarCross RefCross Ref
  21. Kurt Kroenke, Robert L. Spitzer, and Janet B.W. Williams. 2001. The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine 16, 9 (2001), 606–613.Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Yann LeCun, Yoshua Bengio, and Geoffrey Hinton. 2015. Deep learning. nature 521, 7553 (2015), 436–444.Google ScholarGoogle Scholar
  23. Daniel M Low, Laurie Rumker, Tanya Talkar, John Torous, Guillermo Cecchi, and Satrajit S Ghosh. 2020. Natural Language Processing Reveals Vulnerable Mental Health Support Groups and Heightened Health Anxiety on Reddit During COVID-19: Observational Study. Journal of medical Internet research 22, 10 (2020), e22635.Google ScholarGoogle ScholarCross RefCross Ref
  24. Thang Luong, Hieu Pham, and Christopher D. Manning. 2015. Effective approaches to attention-based neural machine translation. In The Conference on Empirical Methods in Natural Language Processing, Lluís Màrquez, Chris Callison-Burch, Jian Su, Daniele Pighin, and Yuval Marton (Eds.). 1412–1421.Google ScholarGoogle ScholarCross RefCross Ref
  25. George Miller, Christiane Fellbaum, Judy Kegl, and Katherine Miller. 2009. WordNet: An Electronic Lexical Reference System Based on Theories of Lexical Memory. Revue québécoise de linguistique 17, 2(2009), 181–212.Google ScholarGoogle Scholar
  26. Julia Mühleck, Sigrid Borse, Eva Wunderer, Bernhard Strauß, and Uwe Berger. 2019. Online-Befragung zur Bekanntheit von Angeboten zur Aufklärung, Prävention, Beratung und Nachsorge bei Essstörungen. Prävention und Gesundheitsförderung 15, 1 (2019), 73–79.Google ScholarGoogle ScholarCross RefCross Ref
  27. Suresh Kumar Mukhiya, Usman Ahmed, Fazle Rabbi, Ka I Pun, and Yngve Lamo. 2020. Adaptation of IDPT System Based on Patient-Authored Text Data using NLP. In IEEE International Symposium on Computer-Based Medical Systems. IEEE, 27–36.Google ScholarGoogle ScholarCross RefCross Ref
  28. Antoine Neuraz, Ivan Lerner, William Digan, Nicolas Paris, Rosy Tsopra, Alice Rogier, David Baudoin, Kevin Bretonnel Cohen, Anita Burgun, Nicolas Garcelon, et al. 2020. Natural language processing for rapid response to emergent diseases: Case study of calcium channel blockers and hypertension in the COVID-19 pandemic. Journal of medical Internet research 22, 8 (2020), e20773.Google ScholarGoogle ScholarCross RefCross Ref
  29. World Health Organization et al. 1993. The ICD-10 classification of mental and behavioural disorders: diagnostic criteria for research. Vol.  2. World Health Organization.Google ScholarGoogle Scholar
  30. Sharnil Pandya, Thippa Reddy Gadekallu, Praveen Kumar Reddy, Weizheng Wang, and Mamoun Alazab. 2022. InfusedHeart: A novel knowledge-infused learning framework for diagnosis of cardiovascular events. IEEE Transactions on Computational Social Systems (2022).Google ScholarGoogle Scholar
  31. Jeffrey Pennington, Richard Socher, and Christopher D Manning. 2014. Glove: Global vectors for word representation. In The Conference on Empirical Methods in Natural Language Processing. 1532–1543.Google ScholarGoogle ScholarCross RefCross Ref
  32. Bornali Phukon, Akash Anil, Sanasam Ranbir Singh, and Priyankoo Sarmah. 2021. Synonymy Expansion Using Link Prediction Methods: A Case Study of Assamese WordNet. Transactions on Asian and Low-Resource Language Information Processing 21, 1(2021), 1–21.Google ScholarGoogle Scholar
  33. Alvin Rajkomar, Eyal Oren, Kai Chen, Andrew M Dai, Nissan Hajaj, Michaela Hardt, Peter J Liu, Xiaobing Liu, Jake Marcus, Mimi Sun, et al. 2018. Scalable and accurate deep learning with electronic health records. NPJ Digital Medicine 1, 1 (2018), 1–10.Google ScholarGoogle ScholarCross RefCross Ref
  34. Sujata Rani and Parteek Kumar. 2021. Aspect-based Sentiment Analysis using Dependency Parsing. Transactions on Asian and Low-Resource Language Information Processing 21, 3(2021), 1–19.Google ScholarGoogle Scholar
  35. Alejandro Santiago, Bernabé Dorronsoro, Antonio J Nebro, Juan J Durillo, Oscar Castillo, and Héctor J Fraire. 2019. A novel multi-objective evolutionary algorithm with fuzzy logic based adaptive selection of operators: FAME. Information Sciences 471(2019), 233–251.Google ScholarGoogle ScholarCross RefCross Ref
  36. Chengai Sun, Liangyu Lv, Gang Tian, and Tailu Liu. 2020. Deep interactive memory network for aspect-level sentiment analysis. ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP) 20, 1 (2020), 1–12.Google ScholarGoogle Scholar
  37. Emily A. Troyer, Jordan N. Kohn, and Suzi Hong. 2020. Are we facing a crashing wave of neuropsychiatric sequelae of COVID-19? Neuropsychiatric symptoms and potential immunologic mechanisms. Brain, Behavior, and Immunity 87 (2020), 34–39.Google ScholarGoogle ScholarCross RefCross Ref
  38. Alfredo Vellido. 2019. The importance of interpretability and visualization in machine learning for applications in medicine and health care. Neural computing and applications(2019), 1–15.Google ScholarGoogle Scholar
  39. Fei Wang, Rainu Kaushal, and Dhruv Khullar. 2020. Should health care demand interpretable artificial intelligence or accept “black box” medicine?Google ScholarGoogle Scholar
  40. Kun Wang, Yanpeng Cui, Jianwei Hu, Yu Zhang, Wei Zhao, and Luming Feng. 2020. Cyberbullying detection, based on the fasttext and word similarity schemes. ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP) 20, 1 (2020), 1–15.Google ScholarGoogle Scholar
  41. Yan Xiang, Zhengtao Yu, Junjun Guo, Yuxin Huang, and Yantuan Xian. 2021. Event Graph Neural Network for Opinion Target Classification of Microblog Comments. Transactions on Asian and Low-Resource Language Information Processing 21, 1(2021), 1–13.Google ScholarGoogle Scholar
  42. Lingling Xu, Ruyi Jin, Feifei Huang, Yanhui Zhou, Zonglong Li, and Minqiang Zhang. 2020. Development of Computerized Adaptive Testing for Emotion Regulation. Frontiers in Psychology 11 (2020), 3340.Google ScholarGoogle ScholarCross RefCross Ref
  43. Zichao Yang, Diyi Yang, Chris Dyer, Xiaodong He, Alex Smola, and Eduard Hovy. 2016. Hierarchical attention networks for document classification. In The Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 1480–1489.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Explainable Deep Attention Active Learning for Sentimental Analytics of Mental Disorder
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in

          Full Access

          • Published in

            cover image ACM Transactions on Asian and Low-Resource Language Information Processing
            ACM Transactions on Asian and Low-Resource Language Information Processing Just Accepted
            ISSN:2375-4699
            EISSN:2375-4702
            Table of Contents

            Copyright © 2022 Association for Computing Machinery.

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Online AM: 27 July 2022
            • Accepted: 21 July 2022
            • Revised: 27 May 2022
            • Received: 4 February 2022
            Published in tallip Just Accepted

            Check for updates

            Qualifiers

            • research-article

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader