skip to main content
research-article
Open Access

Detecting Social Contexts from Mobile Sensing Indicators in Virtual Interactions with Socially Anxious Individuals

Authors Info & Claims
Published:27 September 2023Publication History
Skip Abstract Section

Abstract

Mobile sensing is a ubiquitous and useful tool to make inferences about individuals' mental health based on physiology and behavior patterns. Along with sensing features directly associated with mental health, it can be valuable to detect different features of social contexts to learn about social interaction patterns over time and across different environments. This can provide insight into diverse communities' academic, work and social lives, and their social networks. We posit that passively detecting social contexts can be particularly useful for social anxiety research, as it may ultimately help identify changes in social anxiety status and patterns of social avoidance and withdrawal. To this end, we recruited a sample of highly socially anxious undergraduate students (N=46) to examine whether we could detect the presence of experimentally manipulated virtual social contexts via wristband sensors. Using a multitask machine learning pipeline, we leveraged passively sensed biobehavioral streams to detect contexts relevant to social anxiety, including (1) whether people were in a social situation, (2) size of the social group, (3) degree of social evaluation, and (4) phase of social situation (anticipating, actively experiencing, or had just participated in an experience). Results demonstrated the feasibility of detecting most virtual social contexts, with stronger predictive accuracy when detecting whether individuals were in a social situation or not and the phase of the situation, and weaker predictive accuracy when detecting the level of social evaluation. They also indicated that sensing streams are differentially important to prediction based on the context being predicted. Our findings also provide useful information regarding design elements relevant to passive context detection, including optimal sensing duration, the utility of different sensing modalities, and the need for personalization. We discuss implications of these findings for future work on context detection (e.g., just-in-time adaptive intervention development).

References

  1. Daniel A Adler, Vincent W-S Tseng, Gengmo Qi, Joseph Scarpa, Srijan Sen, and Tanzeem Choudhury. 2021. Identifying Mobile Sensing Indicators of Stress-Resilience. Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies 5, 2 (2021), 1--32.Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Parastoo Alinia, Ramesh Kumar Sah, Michael McDonell, Patricia Pendry, Sara Parent, Hassan Ghasemzadeh, Michael John Cleveland, et al. 2021. Associations between physiological signals captured using wearable sensors and self-reported outcomes among adults in alcohol use disorder recovery: development and usability study. JMIR Formative Research 5, 7 (2021), e27891.Google ScholarGoogle ScholarCross RefCross Ref
  3. Siamak Aram, Amedeo Troiano, and Eros Pasero. 2012. Environment sensing using smartphone. In 2012 IEEE Sensors applications symposium proceedings. IEEE, 1--4.Google ScholarGoogle Scholar
  4. Jakob E Bardram, Mads Frost, Károly Szántó, Maria Faurholt-Jepsen, Maj Vinberg, and Lars Vedel Kessing. 2013. Designing mobile health technology for bipolar disorder: a field trial of the monarca system. In Proceedings of the SIGCHI conference on human factors in computing systems. 2627--2636.Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Miguel Barreda-Ángeles, Sara Aleix-Guillaume, and Alexandre Pereda-Baños. 2020. Users' psychophysiological, vocal, and self-reported responses to the apparent attitude of a virtual audience in stereoscopic 360-video. Virtual Reality 24, 2 (2020), 289--302.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Dror Ben-Zeev, Emily A Scherer, Rui Wang, Haiyi Xie, and Andrew T Campbell. 2015. Next-generation psychiatric assessment: Using smartphone sensors to monitor behavior and mental health. Psychiatric rehabilitation journal 38, 3 (2015), 218.Google ScholarGoogle Scholar
  7. Anita L Blanchard. 2021. The effects of COVID-19 on virtual working within online groups. Group Processes & Intergroup Relations 24, 2 (2021), 290--296.Google ScholarGoogle ScholarCross RefCross Ref
  8. Anna Bleakley, Daniel Rough, Justin Edwards, Philip Doyle, Odile Dumbleton, Leigh Clark, Sean Rintel, Vincent Wade, and Benjamin R Cowan. 2022. Bridging social distance during social distancing: exploring social talk and remote collegiality in video conferencing. Human--Computer Interaction 37, 5 (2022), 404--432.Google ScholarGoogle ScholarCross RefCross Ref
  9. Angela Bonifati, Giovanna Guerrini, Carsten Lutz, Wim Martens, Lara Mazilu, Norman W Paton, Marcos Antonio Vaz Salles, Marc H Scholl, and Yongluan Zhou. 2021. Holding a conference online and live due to Covid-19: Experiences and lessons learned from EDBT/ICDT 2020. ACM SIGMOD Record 49, 4 (2021), 28--32.Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Mehdi Boukhechba, Alexander R Daros, Karl Fua, Philip I Chow, Bethany A Teachman, and Laura E Barnes. 2018. DemonicSalmon: Monitoring mental health and social interactions of college students using smartphones. Smart Health 9 (2018), 192--203.Google ScholarGoogle ScholarCross RefCross Ref
  11. Leo Breiman. 2001. Random forests. Machine learning 45, 1 (2001), 5--32.Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Anne-Marie Brouwer and Maarten A Hogervorst. 2014. A new paradigm to induce mental stress: the Sing-a-Song Stress Test (SSST). Frontiers in neuroscience 8 (2014), 224.Google ScholarGoogle Scholar
  13. Michelle Nicole Burns, Mark Begale, Jennifer Duffecy, Darren Gergle, Chris J Karr, Emily Giangrande, and David C Mohr. 2011. Harnessing context sensing to develop a mobile intervention for depression. Journal of medical Internet research 13, 3 (2011), e1838.Google ScholarGoogle ScholarCross RefCross Ref
  14. Lihua Cai, Mehdi Boukhechba, Congyu Wu, Philip I Chow, Bethany A Teachman, Laura E Barnes, and Matthew S Gerber. 2018. State affect recognition using smartphone sensing data. In Proceedings of the 2018 IEEE/ACM International Conference on Connected Health: Applications, Systems and Engineering Technologies. 120--125.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Youngjae Chang, Akhil Mathur, Anton Isopoussu, Junehwa Song, and Fahim Kawsar. 2020. A systematic study of unsupervised domain adaptation for robust human-activity recognition. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 1 (2020), 1--30.Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. BB Chaudhuri and Ujjwal Bhattacharya. 2000. Efficient training and improved performance of multilayer perceptron in pattern classification. Neurocomputing 34, 1-4 (2000), 11--27.Google ScholarGoogle ScholarCross RefCross Ref
  17. Jianhui Chen, Ji Liu, and Jieping Ye. 2012. Learning incoherent sparse and low-rank patterns from multiple tasks. ACM Transactions on Knowledge Discovery from Data (TKDD) 5, 4 (2012), 1--31.Google ScholarGoogle Scholar
  18. Prerna Chikersal, Afsaneh Doryab, Michael Tumminia, Daniella K Villalba, Janine M Dutcher, Xinwen Liu, Sheldon Cohen, Kasey G Creswell, Jennifer Mankoff, J David Creswell, et al. 2021. Detecting depression and predicting its onset using longitudinal symptoms captured by passive sensing: a machine learning approach with robust feature selection. ACM Transactions on Computer-Human Interaction (TOCHI) 28, 1 (2021), 1--41.Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Yerim Choi, Yu-Mi Jeon, Lin Wang, and Kwanho Kim. 2017. A biological signal-based stress monitoring framework for children using wearable devices. Sensors 17, 9 (2017), 1936.Google ScholarGoogle ScholarCross RefCross Ref
  20. Philip I Chow, Karl Fua, Yu Huang, Wesley Bonelli, Haoyi Xiong, Laura E Barnes, and Bethany A Teachman. 2017. Using mobile sensing to test clinical models of depression, social anxiety, state affect, and social isolation among college students. Journal of medical Internet research 19, 3 (2017), e6820.Google ScholarGoogle ScholarCross RefCross Ref
  21. Margaret Cychosz, Rachel Romeo, Melanie Soderstrom, Camila Scaff, Hillary Ganek, Alejandrina Cristia, Marisa Casillas, Kaya De Barbaro, Janet Y Bang, and Adriana Weisleder. 2020. Longform recordings of everyday life: Ethics for best practices. Behavior research methods 52 (2020), 1951--1969.Google ScholarGoogle Scholar
  22. Valeria De Angel, Serena Lewis, Katie White, Carolin Oetzmann, Daniel Leightley, Emanuela Oprea, Grace Lavelle, Faith Matcham, Alice Pace, David C Mohr, et al. 2022. Digital health tools for the passive monitoring of depression: a systematic review of methods. NPJ digital medicine 5, 1 (2022), 1--14.Google ScholarGoogle Scholar
  23. Francisco de Arriba-Pérez, Juan M Santos-Gago, Manuel Caeiro-Rodríguez, and Mateo Ramos-Merino. 2019. Study of stress detection and proposal of stress-related features using commercial-off-the-shelf wrist wearables. Journal of Ambient Intelligence and Humanized Computing 10 (2019), 4925--4945.Google ScholarGoogle ScholarCross RefCross Ref
  24. Nathan Eagle et al. 2006. Reality mining: sensing complex social systems. Personal and ubiquitous computing 10, 4 (2006), 255--268.Google ScholarGoogle Scholar
  25. Mohamed Elgendi, Ian Norton, Matt Brearley, Derek Abbott, and Dale Schuurmans. 2013. Systolic peak detection in acceleration photoplethysmograms measured from emergency responders in tropical conditions. PloS one 8, 10 (2013), e76585.Google ScholarGoogle ScholarCross RefCross Ref
  26. Aaron Fisher, Cynthia Rudin, and Francesca Dominici. 2019. All Models are Wrong, but Many are Useful: Learning a Variable's Importance by Studying an Entire Class of Prediction Models Simultaneously. J. Mach. Learn. Res. 20, 177 (2019), 1--81.Google ScholarGoogle Scholar
  27. Richard Ribón Fletcher, Sharon Tam, Olufemi Omojola, Richard Redemske, and Joyce Kwan. 2011. Wearable sensor platform and mobile application for use in cognitive behavioral therapy for drug addiction and PTSD. In 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE, 1802--1805.Google ScholarGoogle ScholarCross RefCross Ref
  28. Nan Gao, Wei Shao, Mohammad Saiedur Rahaman, and Flora D Salim. 2020. n-gage: Predicting in-class emotional, behavioural and cognitive engagement in the wild. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 3 (2020), 1--26.Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Grace E Giles, Caroline R Mahoney, Tad T Brunyé, Holly A Taylor, and Robin B Kanarek. 2014. Stress effects on mood, HPA axis, and autonomic response: comparison of three psychosocial stress paradigms. PloS one 9, 12 (2014), e113618.Google ScholarGoogle ScholarCross RefCross Ref
  30. Alberto Greco, Gaetano Valenza, Enzo Pasquale Scilingo, Alberto Greco, Gaetano Valenza, and Enzo Pasquale Scilingo. 2016. Modeling for the Analysis of the EDA. Advances in Electrodermal Activity Processing with Applications for Mental Health: From Heuristic Methods to Convex Optimization (2016), 19--33.Google ScholarGoogle Scholar
  31. Gabriella M Harari, Sandrine R Müller, Min SH Aung, and Peter J Rentfrow. 2017. Smartphone sensing methods for studying behavior in everyday life. Current opinion in behavioral sciences 18 (2017), 83--90.Google ScholarGoogle Scholar
  32. David Hernando, Surya Roca, Jorge Sancho, Álvaro Alesanco, and Raquel Bailón. 2018. Validation of the apple watch for heart rate variability measurements during relax and mental stress in healthy subjects. Sensors 18, 8 (2018), 2619.Google ScholarGoogle ScholarCross RefCross Ref
  33. Gabriela Hoefer, Talie Massachi, Neil G Xu, Nicole Nugent, and Jeff Huang. 2022. Bridging the Social Distance: Offline to Online Social Support during the COVID-19 Pandemic. Proceedings of the ACM on Human-Computer Interaction 6, CSCW2 (2022), 1--27.Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Karen Hovsepian, Mustafa Al'Absi, Emre Ertin, Thomas Kamarck, Motohiro Nakajima, and Santosh Kumar. 2015. cStress: towards a gold standard for continuous stress assessment in the mobile environment. In Proceedings of the 2015 ACM international joint conference on pervasive and ubiquitous computing. 493--504.Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Yu Huang, Haoyi Xiong, Kevin Leach, Yuyan Zhang, Philip Chow, Karl Fua, Bethany A Teachman, and Laura E Barnes. 2016. Assessing social anxiety using GPS trajectories and point-of-interest data. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. 898--903.Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Nicholas Hutchins, Andrew Allen, Michelle Curran, and Lee Kannis-Dymand. 2021. Social anxiety and online social interaction. Australian Psychologist 56, 2 (2021), 142--153.Google ScholarGoogle ScholarCross RefCross Ref
  37. Frank R Ihmig, Frank Neurohr-Parakenings, Sarah K Schäfer, Johanna Lass-Hennemann, and Tanja Michael. 2020. On-line anxiety level detection from biosignals: Machine learning based on a randomized controlled trial with spider-fearful individuals. Plos one 15, 6 (2020), e0231517.Google ScholarGoogle ScholarCross RefCross Ref
  38. Nicholas C Jacobson, Berta Summers, and Sabine Wilhelm. 2020. Digital biomarkers of social anxiety severity: digital phenotyping using passive smartphone sensors. Journal of medical Internet research 22, 5 (2020), e16875.Google ScholarGoogle ScholarCross RefCross Ref
  39. Ron Kohavi and George H John. 1997. Wrappers for feature subset selection. Artificial intelligence 97, 1-2 (1997), 273--324.Google ScholarGoogle Scholar
  40. Santosh Kumar, Wendy J Nilsen, Amy Abernethy, Audie Atienza, Kevin Patrick, Misha Pavel, William T Riley, Albert Shar, Bonnie Spring, Donna Spruijt-Metz, et al. 2013. Mobile health technology evaluation: the mHealth evidence workshop. American journal of preventive medicine 45, 2 (2013), 228--236.Google ScholarGoogle Scholar
  41. Audrey Labrie, Terrance Mok, Anthony Tang, Michelle Lui, Lora Oehlberg, and Lev Poretski. 2022. Toward Video-Conferencing Tools for Hands-On Activities in Online Teaching. Proceedings of the ACM on Human-Computer Interaction 6, GROUP (2022), 1--22.Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Damien Lekkas, Joseph A Gyorda, Erika L Moen, and Nicholas C Jacobson. 2022. Using passive sensor data to probe associations of social structure with changes in personality: A synthesis of network analysis and machine learning. Plos one 17, 11 (2022), e0277516.Google ScholarGoogle ScholarCross RefCross Ref
  43. Jundong Li, Kewei Cheng, Suhang Wang, Fred Morstatter, Robert P Trevino, Jiliang Tang, and Huan Liu. 2017. Feature selection: A data perspective. ACM computing surveys (CSUR) 50, 6 (2017), 1--45.Google ScholarGoogle Scholar
  44. Dominique Makowski, Tam Pham, Zen J. Lau, Jan C. Brammer, François Lespinasse, Hung Pham, Christopher Schölzel, and S. H. Annabel Chen. 2021. NeuroKit2: A Python toolbox for neurophysiological signal processing. Behavior Research Methods 53, 4 (feb 2021), 1689--1696. https://doi.org/10.3758/s13428-020-01516-yGoogle ScholarGoogle ScholarCross RefCross Ref
  45. Aleksandar Matic, Venet Osmani, Alban Maxhuni, and Oscar Mayora. 2012. Multi-modal mobile sensing of social interactions. In 2012 6th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops. IEEE, 105--114.Google ScholarGoogle ScholarCross RefCross Ref
  46. Richard P Mattick and J Christopher Clarke. 1998. Development and validation of measures of social phobia scrutiny fear and social interaction anxiety. Behaviour research and therapy 36, 4 (1998), 455--470.Google ScholarGoogle Scholar
  47. Patrick E McKight and Julius Najab. 2010. Kruskal-wallis test. The corsini encyclopedia of psychology (2010), 1--1.Google ScholarGoogle Scholar
  48. Nir Milstein and Ilanit Gordon. 2020. Validating measures of electrodermal activity and heart rate variability derived from the empatica E4 utilized in research settings that involve interactive dyadic states. Frontiers in Behavioral Neuroscience 14 (2020), 148.Google ScholarGoogle ScholarCross RefCross Ref
  49. Inbal Nahum-Shani, Shawna N Smith, Bonnie J Spring, Linda M Collins, Katie Witkiewitz, Ambuj Tewari, and Susan A Murphy. 2018. Just-in-time adaptive interventions (JITAIs) in mobile health: key components and design principles for ongoing health behavior support. Annals of Behavioral Medicine 52, 6 (2018), 446--462.Google ScholarGoogle ScholarCross RefCross Ref
  50. Subigya Nepal, Weichen Wang, Vlado Vojdanovski, Jeremy F Huckins, Alex daSilva, Meghan Meyer, and Andrew Campbell. 2022. COVID student study: A year in the life of college students during the COVID-19 pandemic through the lens of mobile phone sensing. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1--19.Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. Jennifer Nicholas, Mark Erik Larsen, Judith Proudfoot, Helen Christensen, et al. 2015. Mobile apps for bipolar disorder: a systematic review of features and content quality. Journal of medical Internet research 17, 8 (2015), e4581.Google ScholarGoogle ScholarCross RefCross Ref
  52. Mika Pantzar, Minna Ruckenstein, and Veera Mustonen. 2017. Social rhythms of the heart. Health Sociology Review 26, 1 (2017), 22--37.Google ScholarGoogle ScholarCross RefCross Ref
  53. Alex Pentland. 2000. Looking at people: Sensing for ubiquitous and wearable computing. IEEE Transactions on Pattern analysis and machine intelligence 22, 1 (2000), 107--119.Google ScholarGoogle ScholarDigital LibraryDigital Library
  54. Leif E Peterson. 2009. K-nearest neighbor. Scholarpedia 4, 2 (2009), 1883.Google ScholarGoogle ScholarCross RefCross Ref
  55. Katarzyna Pisanski, Aleksander Kobylarek, Luba Jakubowska, Judyta Nowak, Amelia Walter, Kamil Błaszczyński, Magda Kasprzyk, Krystyna Łysenko, Irmina Sukiennik, Katarzyna Piątek, et al. 2018. Multimodal stress detection: Testing for covariation in vocal, hormonal and physiological responses to Trier Social Stress Test. Hormones and Behavior 106 (2018), 52--61.Google ScholarGoogle ScholarCross RefCross Ref
  56. J. Ross Quinlan. 1996. Learning decision tree classifiers. ACM Computing Surveys (CSUR) 28, 1 (1996), 71--72.Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. Valentin Radu, Catherine Tong, Sourav Bhattacharya, Nicholas D Lane, Cecilia Mascolo, Mahesh K Marina, and Fahim Kawsar. 2018. Multimodal deep learning for activity and context recognition. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 4 (2018), 1--27.Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. Haroon Rashid, Sanjana Mendu, Katharine E Daniel, Miranda L Beltzer, Bethany A Teachman, Mehdi Boukhechba, and Laura E Barnes. 2020. Predicting subjective measures of social anxiety from sparsely collected mobile sensor data. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 3 (2020), 1--24.Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. Irina Rish et al. 2001. An empirical study of the naive Bayes classifier. In IJCAI 2001 workshop on empirical methods in artificial intelligence, Vol. 3. 41--46.Google ScholarGoogle Scholar
  60. Daniel FM Rodrigues, Edgar T Horta, Bruno MC Silva, Fábio DM Guedes, and Joel JPC Rodrigues. 2014. A mobile healthcare solution for ambient assisted living environments. In 2014 IEEE 16th International Conference on e-Health Networking, Applications and Services (Healthcom). IEEE, 170--175.Google ScholarGoogle ScholarCross RefCross Ref
  61. Raúl Rojas et al. 2009. AdaBoost and the super bowl of classifiers a tutorial introduction to adaptive boosting. Freie University, Berlin, Tech. Rep (2009).Google ScholarGoogle Scholar
  62. Laina E Rosebrock, Denada Hoxha, Catherine Norris, John T Cacioppo, and Jackie K Gollan. 2016. Skin conductance and subjective arousal in anxiety, depression, and comorbidity. Journal of Psychophysiology (2016).Google ScholarGoogle Scholar
  63. Akane Sano, Sara Taylor, Andrew W McHill, Andrew JK Phillips, Laura K Barger, Elizabeth Klerman, Rosalind Picard, et al. 2018. Identifying objective physiological markers and modifiable behaviors for self-reported stress and mental health status using wearable sensors and mobile phones: observational study. Journal of medical Internet research 20, 6 (2018), e9410.Google ScholarGoogle ScholarCross RefCross Ref
  64. André C Santos, João MP Cardoso, Diogo R Ferreira, Pedro C Diniz, and Paulo Chaínho. 2010. Providing user context for mobile and social networking applications. Pervasive and Mobile Computing 6, 3 (2010), 324--341.Google ScholarGoogle ScholarDigital LibraryDigital Library
  65. Mohammed Saqr, Jalal Nouri, and Ilkka Jormanainen. 2019. A learning analytics study of the effect of group size on social dynamics and performance in online collaborative learning. In Transforming Learning with Meaningful Technologies: 14th European Conference on Technology Enhanced Learning, EC-TEL 2019, Delft, The Netherlands, September 16--19, 2019, Proceedings 14. Springer, 466--479.Google ScholarGoogle ScholarDigital LibraryDigital Library
  66. Hillol Sarker, Matthew Tyburski, Md Mahbubur Rahman, Karen Hovsepian, Moushumi Sharmin, David H Epstein, Kenzie L Preston, C Debra Furr-Holden, Adam Milam, Inbal Nahum-Shani, et al. 2016. Finding significant stress episodes in a discontinuous time series of rapidly varying mobile sensor data. In Proceedings of the 2016 CHI conference on human factors in computing systems. 4489--4501.Google ScholarGoogle ScholarDigital LibraryDigital Library
  67. Jeffrey D Scargle. 1982. Studies in astronomical time series analysis. II-Statistical aspects of spectral analysis of unevenly spaced data. Astrophysical Journal, Part 1, vol. 263, Dec. 15, 1982, p. 835-853. 263 (1982), 835--853.Google ScholarGoogle Scholar
  68. Hashini Senaratne, Sharon Oviatt, Kirsten Ellis, and Glenn Melvin. 2022. A Critical Review of Multimodal-Multisensor Analytics for Anxiety Assessment. ACM Transactions on Computing for Healthcare 3, 4 (2022), 1--42.Google ScholarGoogle ScholarDigital LibraryDigital Library
  69. Ruksana Shaukat-Jali, Nejra van Zalk, David Edward Boyle, et al. 2021. Detecting subclinical social anxiety using physiological data from a wrist-worn wearable: Small-scale feasibility study. JMIR Formative Research 5, 10 (2021), e32656.Google ScholarGoogle ScholarCross RefCross Ref
  70. George M Slavich, Sara Taylor, and Rosalind W Picard. 2019. Stress measurement using speech: Recent advancements, validation issues, and ethical and privacy considerations. Stress 22, 4 (2019), 408--413.Google ScholarGoogle ScholarCross RefCross Ref
  71. Sara Taylor, Natasha Jaques, Ehimwenma Nosakhare, Akane Sano, and Rosalind Picard. 2017. Personalized multitask learning for predicting tomorrow's mood, stress, and health. IEEE Transactions on Affective Computing 11, 2 (2017), 200--213.Google ScholarGoogle ScholarCross RefCross Ref
  72. Emma Rose Toner, Maria A Larrazabal, Lihua Cai, Teague R Henry, Jennifer MacCormack, Mehdi Boukhechba, Laura Barnes, and Bethany Teachman. 2022. Social anxiety and concordance in emotional responses across levels of evaluative threat. (2022).Google ScholarGoogle Scholar
  73. Emma R Toner, Mark Rucker, Zhiyuan Wang, Maria A Larrazabal, Lihua Cai, Debajyoti Datta, Elizabeth Thompson, Haroon Lone, Mehdi Boukhechba, Bethany A Teachman, et al. 2023. Wearable Sensor-based Multimodal Physiological Responses of Socially Anxious Individuals across Social Contexts. arXiv preprint arXiv:2304.01293 (2023).Google ScholarGoogle Scholar
  74. Vincent W-S Tseng, Akane Sano, Dror Ben-Zeev, Rachel Brian, Andrew T Campbell, Marta Hauser, John M Kane, Emily A Scherer, Rui Wang, Weichen Wang, et al. 2020. Using behavioral rhythms and multi-task learning to predict fine-grained symptoms of schizophrenia. Scientific reports 10, 1 (2020), 1--17.Google ScholarGoogle Scholar
  75. Rui Wang, Fanglin Chen, Zhenyu Chen, Tianxing Li, Gabriella Harari, Stefanie Tignor, Xia Zhou, Dror Ben-Zeev, and Andrew T Campbell. 2014. StudentLife: assessing mental health, academic performance and behavioral trends of college students using smartphones. In Proceedings of the 2014 ACM international joint conference on pervasive and ubiquitous computing. 3--14.Google ScholarGoogle ScholarDigital LibraryDigital Library
  76. Rui Wang, Weichen Wang, Min SH Aung, Dror Ben-Zeev, Rachel Brian, Andrew T Campbell, Tanzeem Choudhury, Marta Hauser, John Kane, Emily A Scherer, et al. 2017. Predicting symptom trajectories of schizophrenia using mobile sensing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 1--24.Google ScholarGoogle ScholarDigital LibraryDigital Library
  77. Rui Wang, Weichen Wang, Alex DaSilva, Jeremy F Huckins, William M Kelley, Todd F Heatherton, and Andrew T Campbell. 2018. Tracking depression dynamics in college students using mobile phone and wearable sensing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 1 (2018), 1--26.Google ScholarGoogle ScholarDigital LibraryDigital Library
  78. Zhiyuan Wang, Mingyue Tang, Maria A Larrazabal, Emma R Toner, Mark Rucker, Congyu Wu, Bethany A Teachman, Mehdi Boukhechba, and Laura E Barnes. 2023. Personalized State Anxiety Detection: An Empirical Study with Linguistic Biomarkers and A Machine Learning Pipeline. arXiv preprint arXiv:2304.09928 (2023).Google ScholarGoogle Scholar
  79. Zhiyuan Wang, Haoyi Xiong, Jie Zhang, Sijia Yang, Mehdi Boukhechba, Daqing Zhang, Laura E Barnes, and Dejing Dou. 2022. From personalized medicine to population health: A survey of mhealth sensing techniques. IEEE Internet of Things Journal (2022).Google ScholarGoogle Scholar
  80. Congyu Wu, Hagen Fritz, Sepehr Bastami, Juan P Maestre, Edison Thomaz, Christine Julien, Darla M Castelli, Kaya de Barbaro, Sarah Kate Bearman, Gabriella M Harari, et al. 2021. Multi-modal data collection for measuring health, behavior, and living environment of large-scale participant cohorts. GigaScience 10, 6 (2021), giab044.Google ScholarGoogle Scholar
  81. Haoyi Xiong, Yu Huang, Laura E Barnes, and Matthew S Gerber. 2016. Sensus: a cross-platform, general-purpose system for mobile crowdsensing in human-subject studies. In Proceedings of the 2016 ACM international joint conference on pervasive and ubiquitous computing. 415--426.Google ScholarGoogle ScholarDigital LibraryDigital Library
  82. Xuhai Xu, Prerna Chikersal, Afsaneh Doryab, Daniella K Villalba, Janine M Dutcher, Michael J Tumminia, Tim Althoff, Sheldon Cohen, Kasey G Creswell, J David Creswell, et al. 2019. Leveraging routine behavior and contextually-filtered features for depression detection among college students. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 3 (2019), 1--33.Google ScholarGoogle ScholarDigital LibraryDigital Library
  83. Xuhai Xu, Prerna Chikersal, Janine M Dutcher, Yasaman S Sefidgar, Woosuk Seo, Michael J Tumminia, Daniella K Villalba, Sheldon Cohen, Kasey G Creswell, J David Creswell, et al. 2021. Leveraging Collaborative-Filtering for Personalized Behavior Modeling: A Case Study of Depression Detection among College Students. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 1 (2021), 1--27.Google ScholarGoogle ScholarDigital LibraryDigital Library
  84. Ju-Yu Yen, Cheng-Fang Yen, Cheng-Sheng Chen, Peng-Wei Wang, Yi-Hsin Chang, and Chih-Hung Ko. 2012. Social anxiety in online and real-life interaction and their associated factors. Cyberpsychology, Behavior, and Social Networking 15, 1 (2012), 7--12.Google ScholarGoogle ScholarCross RefCross Ref
  85. Özgür Yürür, Chi Harold Liu, Zhengguo Sheng, Victor CM Leung, Wilfrido Moreno, and Kin K Leung. 2014. Context-awareness for mobile sensing: A survey and future directions. IEEE Communications Surveys & Tutorials 18, 1 (2014), 68--93.Google ScholarGoogle ScholarDigital LibraryDigital Library
  86. Camellia Zakaria, Rajesh Balan, and Youngki Lee. 2019. StressMon: scalable detection of perceived stress and depression using passive sensing of changes in work Routines and group interactions. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (2019), 1--29.Google ScholarGoogle ScholarDigital LibraryDigital Library
  87. Yongli Zhang. 2012. Support vector machine classification algorithm and its application. In International conference on information computing and applications. Springer, 179--186.Google ScholarGoogle ScholarCross RefCross Ref
  88. Yu Zhang and Qiang Yang. 2018. An overview of multi-task learning. National Science Review 5, 1 (2018), 30--43.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Detecting Social Contexts from Mobile Sensing Indicators in Virtual Interactions with Socially Anxious Individuals

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
          Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 7, Issue 3
          September 2023
          1734 pages
          EISSN:2474-9567
          DOI:10.1145/3626192
          Issue’s Table of Contents

          Copyright © 2023 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 27 September 2023
          Published in imwut Volume 7, Issue 3

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
          • Research
          • Refereed

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader