Abstract
With the increasing use of online mediums, Internet-delivered psychological treatments (IDPs) are becoming an essential tool for improving mental disorders. Online-based health therapies can help a large segment of the population with little resource investment. The task is greatly complicated by the overlapping emotions for specific mental health. Early adoption of a deep learning system presented severe difficulties, including ethical and legal considerations that contributed to a lack of trust. Modern models required highly interpretable, intuitive explanations that humans could understand. To achieve this, we present a deep attention model based on fuzzy classification that uses the linguistic features of patient texts to build emotional lexicons. In medical applications, a diversified dataset generates work. Active learning techniques are used to extend fuzzy rules and the learned dataset gradually. From this, the model can gain a reduction in labeling efforts in mental health applications. In this way, difficulties such as the amount of vocabulary per class, method of generation, the source of data, and the baseline for human performance level can be solved. Moreover, this work illustrates fuzzy explainability by using weighted terms. The proposed method incorporates a subset of unstructured data into the set for training and uses a similarity-based approach. The approach then updates the model training using the new training points in the subsequent cycle of the active learning mechanism. The cycle is repeated until the optimal solution is found. At this point, all unlabeled text is converted into the set for training. The experimental results show that the emotion-based enhancement improves test accuracy and helps develop quality criteria. In the blind test, the bidirectional LSTM architecture with an attention mechanism and fuzzy classification achieved an F1 score of 0.89.
- Juan Aguilera, Delia Irazú Hernández Farías, Rosa María Ortega-Mendoza, and Manuel Montes-y Gómez. 2021. Depression and anorexia detection in social media as a one-class classification problem. Applied Intelligence(2021), 1–16.Google Scholar
- Usman Ahmed, Muhammad Aleem, Yasir Noman Khalid, Muhammad Arshad Islam, and Muhammad Azhar Iqbal. 2019. RALB-HC: A resource-aware load balancer for heterogeneous cluster. Concurrency and Computation: Practice and Experience (2019), e5606.Google Scholar
- Usman Ahmed, Jerry Chun-Wei Lin*, and Gautam Srivastava. 2022. Fuzzy Contrast Set Based Deep Attention Network for Lexical Analysis and Mental Health Treatment. Transactions on Asian and Low-Resource Language Information Processing (2022).Google Scholar
- Usman Ahmed, Jerry Chun Wei Lin, Gautam Srivastava, and Muhammad Aleem. 2020. A load balance multi-scheduling model for OpenCL kernel tasks in an integrated cluster. Soft Computing (2020), 1–14.Google Scholar
- KS Arikumar, Sahaya Beni Prathiba, Mamoun Alazab, Thippa Reddy Gadekallu, Sharnil Pandya, Javed Masood Khan, and Rajalakshmi Shenbaga Moorthy. 2022. FL-PMI: federated learning-based person movement identification through wearable devices in smart healthcare systems. Sensors 22, 4 (2022), 1377.Google ScholarCross Ref
- Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015. Neural machine translation by jointly learning to align and translate. In The International Conference on Learning Representations, Yoshua Bengio and Yann LeCun (Eds.). ICLR, 24–34.Google Scholar
- Xiangyi Chen, Steven Z Wu, and Mingyi Hong. 2020. Understanding gradient clipping in private SGD: A geometric perspective. Advances in Neural Information Processing Systems 33 (2020), 1–10.Google Scholar
- Edward Choi, Mohammad Taha Bahadori, Andy Schuetz, Walter F Stewart, and Jimeng Sun. 2016. Doctor ai: Predicting clinical events via recurrent neural networks. In Machine learning for healthcare conference. 301–318.Google Scholar
- Palash Dutta and Soumendra Goala. 2018. Fuzzy decision making in medical diagnosis using an advanced distance measure on intuitionistic fuzzy sets. The Open Cybernetics & Systemics Journal 12, 1 (2018).Google ScholarCross Ref
- Robin C Feldman, Ehrik Aldana, and Kara Stein. 2019. Artificial intelligence in the health care space: how we can trust what we cannot know. Stan. L. & Pol’y Rev. 30 (2019), 399.Google Scholar
- Jiří Filip and Tomáš Kliegr. 2018. Classification based on Associations (CBA)-a performance analysis. Technical Report. EasyChair.Google Scholar
- Xiaoqing Gu, Kaijian Xia, Yizhang Jiang, and Alireza Jolfaei. 2021. Multi-task Fuzzy Clustering–Based Multi-task TSK Fuzzy System for Text Sentiment Classification. Transactions on Asian and Low-Resource Language Information Processing 21, 2(2021), 1–24.Google Scholar
- David Gunning. 2017. Explainable artificial intelligence (xai). Defense Advanced Research Projects Agency (DARPA), nd Web 2, 2(2017).Google Scholar
- Alex Holub, Pietro Perona, and Michael C Burl. 2008. Entropy-based active learning for object recognition. In IEEE Conference on Computer Vision and Pattern Recognition Workshops. 1–8.Google ScholarCross Ref
- Andreas Holzinger, Georg Langs, Helmut Denk, Kurt Zatloukal, and Heimo Müller. 2019. Causability and explainability of artificial intelligence in medicine. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery 9, 4(2019), e1312.Google ScholarCross Ref
- Nasir Jamal, Chen Xianqiao, Fadi Al-Turjman, and Farhan Ullah. 2021. A Deep Learning–based Approach for Emotions Classification in Big Corpus of Imbalanced Tweets. Transactions on Asian and Low-Resource Language Information Processing 20, 3(2021), 1–16.Google ScholarDigital Library
- Kipp W Johnson, Jessica Torres Soto, Benjamin S Glicksberg, Khader Shameer, Riccardo Miotto, Mohsin Ali, Euan Ashley, and Joel T Dudley. 2018. Artificial intelligence in cardiology. Journal of the American College of Cardiology 71, 23(2018), 2668–2679.Google ScholarCross Ref
- Christian Karmen, Robert C. Hsiung, and Thomas Wetter. 2015. Screening Internet forum participants for depression symptoms by assembling and enhancing multiple NLP methods. Computer Methods and Programs in Biomedicine 120, 1(2015), 27–36.Google ScholarDigital Library
- Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980(2014).Google Scholar
- Chayakrit Krittanawong, HongJu Zhang, Zhen Wang, Mehmet Aydar, and Takeshi Kitai. 2017. Artificial intelligence in precision cardiovascular medicine. Journal of the American College of Cardiology 69, 21(2017), 2657–2664.Google ScholarCross Ref
- Kurt Kroenke, Robert L. Spitzer, and Janet B.W. Williams. 2001. The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine 16, 9 (2001), 606–613.Google ScholarDigital Library
- Yann LeCun, Yoshua Bengio, and Geoffrey Hinton. 2015. Deep learning. nature 521, 7553 (2015), 436–444.Google Scholar
- Daniel M Low, Laurie Rumker, Tanya Talkar, John Torous, Guillermo Cecchi, and Satrajit S Ghosh. 2020. Natural Language Processing Reveals Vulnerable Mental Health Support Groups and Heightened Health Anxiety on Reddit During COVID-19: Observational Study. Journal of medical Internet research 22, 10 (2020), e22635.Google ScholarCross Ref
- Thang Luong, Hieu Pham, and Christopher D. Manning. 2015. Effective approaches to attention-based neural machine translation. In The Conference on Empirical Methods in Natural Language Processing, Lluís Màrquez, Chris Callison-Burch, Jian Su, Daniele Pighin, and Yuval Marton (Eds.). 1412–1421.Google ScholarCross Ref
- George Miller, Christiane Fellbaum, Judy Kegl, and Katherine Miller. 2009. WordNet: An Electronic Lexical Reference System Based on Theories of Lexical Memory. Revue québécoise de linguistique 17, 2(2009), 181–212.Google Scholar
- Julia Mühleck, Sigrid Borse, Eva Wunderer, Bernhard Strauß, and Uwe Berger. 2019. Online-Befragung zur Bekanntheit von Angeboten zur Aufklärung, Prävention, Beratung und Nachsorge bei Essstörungen. Prävention und Gesundheitsförderung 15, 1 (2019), 73–79.Google ScholarCross Ref
- Suresh Kumar Mukhiya, Usman Ahmed, Fazle Rabbi, Ka I Pun, and Yngve Lamo. 2020. Adaptation of IDPT System Based on Patient-Authored Text Data using NLP. In IEEE International Symposium on Computer-Based Medical Systems. IEEE, 27–36.Google ScholarCross Ref
- Antoine Neuraz, Ivan Lerner, William Digan, Nicolas Paris, Rosy Tsopra, Alice Rogier, David Baudoin, Kevin Bretonnel Cohen, Anita Burgun, Nicolas Garcelon, et al. 2020. Natural language processing for rapid response to emergent diseases: Case study of calcium channel blockers and hypertension in the COVID-19 pandemic. Journal of medical Internet research 22, 8 (2020), e20773.Google ScholarCross Ref
- World Health Organization et al. 1993. The ICD-10 classification of mental and behavioural disorders: diagnostic criteria for research. Vol. 2. World Health Organization.Google Scholar
- Sharnil Pandya, Thippa Reddy Gadekallu, Praveen Kumar Reddy, Weizheng Wang, and Mamoun Alazab. 2022. InfusedHeart: A novel knowledge-infused learning framework for diagnosis of cardiovascular events. IEEE Transactions on Computational Social Systems (2022).Google Scholar
- Jeffrey Pennington, Richard Socher, and Christopher D Manning. 2014. Glove: Global vectors for word representation. In The Conference on Empirical Methods in Natural Language Processing. 1532–1543.Google ScholarCross Ref
- Bornali Phukon, Akash Anil, Sanasam Ranbir Singh, and Priyankoo Sarmah. 2021. Synonymy Expansion Using Link Prediction Methods: A Case Study of Assamese WordNet. Transactions on Asian and Low-Resource Language Information Processing 21, 1(2021), 1–21.Google Scholar
- Alvin Rajkomar, Eyal Oren, Kai Chen, Andrew M Dai, Nissan Hajaj, Michaela Hardt, Peter J Liu, Xiaobing Liu, Jake Marcus, Mimi Sun, et al. 2018. Scalable and accurate deep learning with electronic health records. NPJ Digital Medicine 1, 1 (2018), 1–10.Google ScholarCross Ref
- Sujata Rani and Parteek Kumar. 2021. Aspect-based Sentiment Analysis using Dependency Parsing. Transactions on Asian and Low-Resource Language Information Processing 21, 3(2021), 1–19.Google Scholar
- Alejandro Santiago, Bernabé Dorronsoro, Antonio J Nebro, Juan J Durillo, Oscar Castillo, and Héctor J Fraire. 2019. A novel multi-objective evolutionary algorithm with fuzzy logic based adaptive selection of operators: FAME. Information Sciences 471(2019), 233–251.Google ScholarCross Ref
- Chengai Sun, Liangyu Lv, Gang Tian, and Tailu Liu. 2020. Deep interactive memory network for aspect-level sentiment analysis. ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP) 20, 1 (2020), 1–12.Google Scholar
- Emily A. Troyer, Jordan N. Kohn, and Suzi Hong. 2020. Are we facing a crashing wave of neuropsychiatric sequelae of COVID-19? Neuropsychiatric symptoms and potential immunologic mechanisms. Brain, Behavior, and Immunity 87 (2020), 34–39.Google ScholarCross Ref
- Alfredo Vellido. 2019. The importance of interpretability and visualization in machine learning for applications in medicine and health care. Neural computing and applications(2019), 1–15.Google Scholar
- Fei Wang, Rainu Kaushal, and Dhruv Khullar. 2020. Should health care demand interpretable artificial intelligence or accept “black box” medicine?Google Scholar
- Kun Wang, Yanpeng Cui, Jianwei Hu, Yu Zhang, Wei Zhao, and Luming Feng. 2020. Cyberbullying detection, based on the fasttext and word similarity schemes. ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP) 20, 1 (2020), 1–15.Google Scholar
- Yan Xiang, Zhengtao Yu, Junjun Guo, Yuxin Huang, and Yantuan Xian. 2021. Event Graph Neural Network for Opinion Target Classification of Microblog Comments. Transactions on Asian and Low-Resource Language Information Processing 21, 1(2021), 1–13.Google Scholar
- Lingling Xu, Ruyi Jin, Feifei Huang, Yanhui Zhou, Zonglong Li, and Minqiang Zhang. 2020. Development of Computerized Adaptive Testing for Emotion Regulation. Frontiers in Psychology 11 (2020), 3340.Google ScholarCross Ref
- Zichao Yang, Diyi Yang, Chris Dyer, Xiaodong He, Alex Smola, and Eduard Hovy. 2016. Hierarchical attention networks for document classification. In The Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 1480–1489.Google ScholarCross Ref
Index Terms
- Explainable Deep Attention Active Learning for Sentimental Analytics of Mental Disorder
Recommendations
Deep Hierarchical Attention Active Learning for Mental Disorder Unlabeled Data in AIoMT
In the Artificial Intelligence of Medical Things (AIoMT), Internet-Delivered Psychological Treatment (IDPT) effectively improves the quality of mental health treatments. With the advent of COVID-19, psychological tasks have become overloaded and ...
EANDC: An explainable attention network based deep adaptive clustering model for mental health treatment
AbstractInternet-delivered Psychological Treatment (IDPT) has been shown to be an effective method for improving psychological disorders. Natural language processing (NLP) requires an appropriate set of linguistic features for word ...
Highlights- We propose a tool for psychologists to examine the emotional aspects of mental health.
Fuzzy Explainable Attention-based Deep Active Learning on Mental-Health Data
2021 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE)In this paper, we propose a fuzzy classification deep attention-based model that expands emotional lexicons by using linguistic properties of actual patient authored texts. The active learning methods can expand the trained dataset and fuzzy rules over ...
Comments