Aditya Ponnada
Skip Abstract Section
Abstract
Mobile-based ecological-momentary-assessment (EMA) is an in-situ measurement methodology where an electronic device prompts a person to answer questions of research interest. EMA has a key limitation: interruption burden. Microinteraction-EMA(µEMA) may reduce burden without sacrificing high temporal density of measurement. In µEMA, all EMA prompts can be answered with ‘at a glance' microinteractions. In a prior 4-week pilot study comparing standard EMA delivered on a phone (phone-EMA) vs. µEMA delivered on a smartwatch (watch-µEMA), watch-µEMA demonstrated higher response rates and lower perceived burden than phone-EMA, even when the watch-µEMA interruption rate was 8 times more than phone-EMA. A new 4-week dataset was gathered on smartwatch-based EMA (i.e., watch-EMA with 6 back-to-back, multiple-choice questions on a watch) to compare whether the high response rates of watch-µEMA previously observed were a result of using microinteractions, or due to the novelty and accessibility of the smartwatch. No statistically significant differences in compliance, completion, and first-prompt response rates were observed between phone-EMA and watch-EMA. However, watch-µEMA response rates were significantly higher than watch-EMA. This pilot suggests that (1) the high compliance and low burden previously observed in watch-µEMA is likely due to the microinteraction question technique, not simply the use of the watch versus the phone, and that (2) compliance with traditional EMA (with long surveys) may not improve simply by moving survey delivery from the phone to a smartwatch.
- Ahmed M. Abdel-Khalek. 2006. Measuring happiness with a single-item scale. Social Behavior and Personality: An International Journal 34 2: 139-150.Google Scholar
Cross Ref
- Saeed Abdullah, Elizabeth L. Murnane, Mark Matthews, Matthew Kay, Julie A. Kientz, Geri Gay, and Tanzeem Choudhury. 2016. Cognitive rhythms: Unobtrusive and continuous sensing of alertness using a mobile phone. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp ‘16). ACM, New York, NY, USA, 178-189. Google ScholarDigital Library
- Daniel L. Ashbrook, James R. Clawson, Kent Lyons, Thad E. Starner, and Nirmal Patel. 2008. Quickdraw: The impact of mobility and on-body placement on device access time. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ‘08). ACM, New York, NY, USA, 219-222. Google ScholarDigital Library
- Daniel J. Beal and Howard M. Weiss. 2003. Methods of ecological momentary assessment in organizational research. Organizational Research Methods 6, 4:440-464.Google ScholarCross Ref
- Lars Bergkvist and John R. Rossiter. 2007. The predictive validity of multiple-item versus single-item measures of the same constructs. Journal of Marketing Research 44 2: 175-184.Google Scholar
- Daniel E. Berlyne. 1950. Novelty and curiosity as determinants of exploratory behavior. British J of Psychology 41, 1-2:68-80.Google Scholar
- Prem C. Consul, and Gaurav C. Jain. 1973. A generalization of the Poisson distribution. Technometrics 15.4: 791-799.Google ScholarCross Ref
- Cora L. Craig, Alison L. Marshall, Michael Sjöström, Adrian E. Bauman, Michael L. Booth, Barbara E. Ainsworth, and Michael Pratt. 2003. International Physical Activity Questionnaire: 12-country reliability and validity. Medicine 8 Science in Sports 8 Exercise 35 8: 1381-1395.Google Scholar
- Kelley A. Cunny and Matthew Perri III. 1991. Single-item vs multiple-item measures of health-related quality of life. Psychological Reports 69 1: 127-130.Google Scholar
- Shelly A. Curran, Abbie O. Beacham, and Micheal A. Andrykowski. 2004. Ecological momentary assessment of fatigue following breast cancer treatment. Journal of Behavioral Medicine 27, 5:425-444.Google ScholarCross Ref
- David Cella, Richard Gershon, Jin-Shei Lai, and Seung Choi. 2007. The future of outcomes measurement: Item banking, tailored short-forms, and computerized adaptive assessment. Quality of Life Research 16 1: 133-141.Google Scholar
- Anind K. Dey, Katarzyna Wac, Denzil Ferreira, Kevin Tassini, Jin-Hyuk Hong, and Julian Ramos. 2011. Getting closer: An empirical investigation of the proximity of user to their smart phones. In Proceedings of the 13th International Conference on Ubiquitous Computing (UbiComp ‘11). ACM, New York, NY, USA, 163-172. Google ScholarDigital Library
- Genevieve F. Dunton, Keito Kawabata, Stephen S. Intille, Jennifer Wolch and Marry A. Pentz. 2011. Physical and social contextual influences on children's leisure-time physical activity: An ecological momentary assessment study. Journal of Physical Activity and Health 26, 3: 135-142.Google Scholar
- Francis S. Collins and Harold Varmus. 2015. A new initiative on precision medicine. New Eng. J. Med 372: 793-795.Google ScholarCross Ref
- Bradley S. Galer and Mark P. Jensen. 1997. Development and preliminary validation of a pain measure specific to neuropathic pain: The Neuropathic Pain Scale. Neurology 48 2: 332 -- 338.Google ScholarCross Ref
- Donald G. Gardner, Larry L. Cummings, Randall B. Dunham, and Jon L. Pierce. 1998. Single-item versus multiple-item measurement scales: An empirical comparison. Educational and Psychological Measurement 58 6: 898-915.Google Scholar
- Louise C. Hawkley. 2003. Loneliness in everyday life: Cardiovascular activity, psychosocial context, and health behaviors. Journal of Personality and Social Psychology 85, 1:105-120.Google ScholarCross Ref
- Javier Hernandez, Daniel McDuff, Christian Infante, Pattie Maes, Karen Quigley, and Rosalind Picard. 2016. Wearable ESM: Differences in the experience sampling method across wearable devices. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI ‘16). ACM, New York, NY, USA, 195-205. Google ScholarDigital Library
- Kristin E. Heron and Joshua M. Smyth. 2010. Ecological momentary interventions: Incorporating mobile technology into psychosocial and health behavior treatments. British Journal of Health Psychology 15: 1-39.Google ScholarCross Ref
- Marianne J. Hjermstad, Peter M. Fayers, Dagny F. Haugen, Augusto Caraceni, Geoffrey W. Hanks, Jon H. Loge, Robin Fainsinger, Nina Aass, and Stein Kaasa. 2011. Studies comparing Numerical Rating Scales, Verbal Rating Scales, and Visual Analogue Scales for assessment of pain intensity in adults: A systematic literature review. Journal of Pain and Symptom Management 41 6: 1073-1093.Google Scholar
- Stephen Intille, Caitlin Haynes, Dharam Maniar, Aditya Ponnada and Justin Manjourides. 2016. µEMA: Micro-interactions based ecological momentary assessments (EMA) using a smartwatch. In Proceedings of the ACM International Conference on Ubiquitous and Pervasive Computing (UbiComp'16). ACM, New York, NY, USA. Google ScholarDigital Library
- S. S. Intille. 2007. Technological innovations enabling automatic, context-sensitive ecological momentary assessment. in The Science of Real-Time Data Capture: Self-Report in Health Research, A. A. Stone, S. Shiffman, A. A. Atienza, and L. Nebeling, Eds: Oxford University Press: 308-337.Google Scholar
- Janko Timmermann, Wilko Heuten, and Susanne Boll. 2015. Input methods for the Borg-RPE-scale on smartwatches. In 9th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth'15): 80-83. Google ScholarDigital Library
- Hiroe Kikuchi, Kazuhiro Yoshiuchi, Yoshiharu Yamamoto, Gen Komaki and Akira Akabayashi. 2011. Does sleep aggravate tension-type headache?: An investigation using computerized ecological momentary assessment and actigraphy. Biopsychosoc Med 5, 10.Google ScholarCross Ref
- Jinhyuk Kim, Hiroe Kikuchi, and Yoshiharu Yamamoto. 2013. Systematic comparison between ecological momentary assessment and day reconstruction method for fatigue and mood states in healthy adults. British J of Health Psych 18:155-67.Google ScholarCross Ref
- Jinhyuk Kim, Toru Nakamura, Hiroe Kikuchi, Tsukasa Saaki, and Yoshiharu Yamamoto. 2013. Co-variation of depressive mood and locomotor dynamics evaluated by ecological momentary assessment in healthy humans. PloS One 8: e74979.Google ScholarCross Ref
- Samuel Kotz, Narayanswamy Balakrishnan, and Norman L. Johnson. 2004. Continuous multivariate distributions, models and applications. John Wiley 8 Sons, New Jersey, USA.Google Scholar
- Jacob Eg. Larsen, Kasper Eskelund, and Thomas B. Christiansen. 2011. Active self-tracking of subjective experience with a one-button wearable: A case study in military PTSD. 2nd Symposia on Computing and Mental Health. in Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, Denver CO.Google Scholar
- Kent Lyons. 2015. Using digital watch practices to inform smartwatch design. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA ‘15). ACM, New York, NY, USA, 2199-2204. Google ScholarDigital Library
- Pagano Marcello and Kimberlee Gauvreau. 2000. Principles of Biostatistics. Vol. 2. Pacific Grove, CA.Google Scholar
- Daniel McFadden. 1973. Conditional logit analysis of qualitative choice behavior, Berkeley, USA.Google Scholar
- Chulhong Min, Seungwoo Kang, Chungkuk Yoo, Jeehoon Cha, Sangwon Choi, Younghan Oh, and Junehwa Song. 2015. Exploring current practices for battery use and management of smartwatches. In Proceedings of the 2015 ACM International Symposium on Wearable Computers (ISWC ‘15). ACM, New York, NY, USA, 11-18. Google ScholarDigital Library
- Stefania Pizza, Barry Brown, Donald McMillan, and Airi Lampinen. 2016. Smartwatch in vivo. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI ‘16). ACM, New York, NY, USA, 5456-5469. Google ScholarDigital Library
- Judith Proudfoot. 2013. The future is in our hands: The role of mobile phones in the prevention and management of mental disorders. Australian and New Zealand Journal of Psychiatry, 47 2: 111-113.Google ScholarCross Ref
- Richard W. Robins, Holly M. Hendin, and Kali H. Trzesniewski. 2001. Measuring global self-esteem: Construct validation of a single-item measure and the Rosenberg Self-Esteem Scale. Personality and Social Psychology Bulletin 27 2: 151-161.Google Scholar
- Morris Rosenberg. 1965. Society and the adolescent self-image. Vol. 11. Princeton University Press. Princeton, NJ.Google Scholar
- Saul Shiffman, Arthur A. Stone, and Michael R. Hufford. 2008. Ecological momentary assessment. Annual Review Clinical Psychology 4:1-32.Google ScholarCross Ref
- Saul Shiffman. 2000. Real-time self-report of momentary states in the natural environment: Computerized ecological momentary assessment. The Science of Self-report: Implications for Research and Practice: 277-296.Google Scholar
- Arthur A. Stone and Saul Shiffman. 1994. Ecological momentary assessment (EMA) in behavioral medicine. Annals of Behavioral Medicine 16, 3:199-202.Google ScholarCross Ref
- Arthur A. Stone, Saul Shiffman, Audie A. Atienza and Linda Nebeling. 2007. Historical roots and rationale of ecological momentary assessment (EMA). In The Science of Real-Time Data Capture: Self-Reports in Health Research, A.A. Stone, S. Shiffman, A. Antienza, and L. Nebeling, Editors. Oxford University Press: New York, NY:3-10.Google Scholar
- Erin I. Walsh and Jay K. Brinker. 2016. Should participants be given a mobile phone, or use their own? Effects of novelty vs utility. Telematics and Informatics 33, 1:25-33. Google ScholarDigital Library
- David Watson, Lee A. Clark, and Auke Tellegen. 1988. Development and validation of brief measures of positive and negative affect: The PANAS scales. Journal Personality and Social Psychology 54, 6:1063-70.Google ScholarCross Ref
- Worldwide Wearables Market Increases 67.2% Amid Seasonal Retrenchment, According to IDC. 2016. Retrieved September 6, 2016 from http://www.idc.com/getdoc.jsp?containerId=prUS41284516.Google Scholar
Index Terms
- Microinteraction Ecological Momentary Assessment Response Rates: Effect of Microinteractions or the Smartwatch?
Recommendations
Contextual Biases in Microinteraction Ecological Momentary Assessment (μEMA) Non-response
Ecological momentary assessment (EMA) is used to gather in-situ self-report on behaviors using mobile devices. Microinteraction EMA (μEMA), is a type of EMA where each survey is only one single question that can be answered with a glanceable ...
μEMA: Microinteraction-based ecological momentary assessment (EMA) using a smartwatch
UbiComp '16: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous ComputingEcological Momentary Assessment (EMA) is a method of in situ data collection for assessment of behaviors, states, and contexts. Questions are prompted during everyday life using an individual's mobile device, thereby reducing recall bias and increasing ...
Students' Experiences with Ecological Momentary Assessment Tools to Report on Emotional Well-being
Ecological Momentary Assessment (EMA) methods have emerged as an approach that enhances the ecological validity of data collected for the study of human behavior and experience. In particular, EMA methods are used to capture individuals' experiences (...
Comments