Tadashi Okoshi
Kota Tsubouchi
Hideyuki Tokuda
ABSTRACT
The limited attentional resource of users is a bottleneck to delivery of push notifications in today's mobile and ubiquitous computing environments. Adaptive mobile notification scheduling, which detects opportune timings based on mobile sensing and machine learning, has been proposed as a way of alleviating this problem. However, it is still not clear if such adaptive notifications are effective in a large-scale product deployment with real-world situations and configurations, such as users' context changes, personalized content in notifications, and sudden external factors that users commonly experience (such as breaking news). In this paper, we construct a new interruptibility estimation and adaptive notification scheduling with redesigned technical components. From the deploy study of the system to the real product stack of Yahoo! JAPAN Android application and evaluation with 382,518 users for 28 days, we confirmed several significant results, including the maximum 60.7% increase in the users' click rate, 10 times more gain compared to the previous system, significantly better gain in the personalized notification content, and unexpectedly better performance in a situation with exceptional breaking news notifications. With these results, the proposed system has officially been deployed and enabled to all the users of Yahoo! JAPAN product environment where more than 10 million Android app users are enjoying its benefit.
- Utku Acer, Afra Mashhadi, Claudio Forlivesi, and Fahim Kawsar. 2015. Energy Efficient Scheduling for Mobile Push Notifications. In Proceedings of the 12th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services on 12th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services (MOBIQUITOUS'15). 100--109. Google Scholar
Digital Library
- Piotr D. Adamczyk and Brian P. Bailey. 2004. If not now, when?: the effects of interruption at different moments within task execution. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '04). 271--278. Google ScholarDigital Library
- Brian P. Bailey and Joseph A. Konstan. 2006. On the need for attention-aware systems: Measuring effects of interruption on task performance, error rate, and affective state. Computers in Human Behavior , Vol. 22, 4 (2006), 685 -- 708.Google ScholarCross Ref
- James "Bo" Begole, Nicholas E. Matsakis, and John C. Tang. 2004. Lilsys: Sensing Unavailability. In Proceedings of the 2004 ACM Conference on Computer Supported Cooperative Work (CSCW '04). 511--514. Google ScholarDigital Library
- Mary Czerwinski, Edward Cutrell, and Eric Horvitz. 2000. Instant messaging: Effects of relevance and timing. In People and computers XIV: Proceedings of HCI, Vol. 2. British Computer Society, 71--76.Google Scholar
- Joel E. Fischer, Chris Greenhalgh, and Steve Benford. 2011. Investigating Episodes of Mobile Phone Activity As Indicators of Opportune Moments to Deliver Notifications. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '11). 181--190. Google ScholarDigital Library
- D. Garlan, D.P. Siewiorek, A. Smailagic, and P. Steenkiste. 2002. Project Aura: toward distraction-free pervasive computing. Pervasive Computing, IEEE , Vol. 1, 2 (april-june 2002), 22 --31. Google ScholarDigital Library
- Google Inc. {n. d.}. Making Your App Location-Aware - Android Developers . https://developer.android.com/intl/ja/training/location/index.html .Google Scholar
- Sandy Gould, Duncan Brumby, Anna Cox, Victor González, Dario Salvucci, and Niels Taatgen. 2012. Multitasking and interruptions: a SIG on bridging the gap between research on the micro and macro worlds. In CHI'12 Extended Abstracts on Human Factors in Computing Systems. 1189--1192. Google ScholarDigital Library
- Joyce Ho and Stephen S. Intille. 2005. Using Context-aware Computing to Reduce the Perceived Burden of Interruptions from Mobile Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '05). 909--918. Google ScholarDigital Library
- Eric Horvitz and Johnson Apacible. 2003. Learning and Reasoning About Interruption. In Proceedings of the 5th International Conference on Multimodal Interfaces (ICMI '03). 20--27. Google ScholarDigital Library
- Eric Horvitz, Paul Koch, and Johnson Apacible. 2004. BusyBody: Creating and Fielding Personalized Models of the Cost of Interruption. In Proceedings of the 2004 ACM Conference on Computer Supported Cooperative Work (CSCW '04). 507--510. Google ScholarDigital Library
- Scott Hudson, James Fogarty, Christopher Atkeson, Daniel Avrahami, Jodi Forlizzi, Sara Kiesler, Johnny Lee, and Jie Yang. 2003. Predicting Human Interruptibility with Sensors: A Wizard of Oz Feasibility Study. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '03). 257--264. Google ScholarDigital Library
- Shamsi T. Iqbal and Brian P. Bailey. 2006. Leveraging Characteristics of Task Structure to Predict the Cost of Interruption. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '06). 741--750. Google ScholarDigital Library
- Shamsi T. Iqbal and Brian P. Bailey. 2005. Investigating the Effectiveness of Mental Workload As a Predictor of Opportune Moments for Interruption. In CHI '05 Extended Abstracts on Human Factors in Computing Systems (CHI EA '05). 1489--1492. Google ScholarDigital Library
- Shamsi T. Iqbal and Brian P. Bailey. 2010. Oasis: A Framework for Linking Notification Delivery to the Perceptual Structure of Goal-directed Tasks. ACM Transactions on Computer-Human Interaction , Vol. 17, 4, Article 15 (Dec. 2010), bibinfonumpages28 pages. Google ScholarDigital Library
- Shamsi T. Iqbal and Eric Horvitz. 2010. Notifications and Awareness: A Field Study of Alert Usage and Preferences. In Proceedings of the 2010 ACM Conference on Computer Supported Cooperative Work (CSCW '10). 27--30. Google ScholarDigital Library
- Daniel Kahneman. 1973. Attention and effort .Prentice-Hall, Inc.Google Scholar
- J. G. Kreifeldt and M. E. McCarthy. 1981. Interruption as a test of the user-computer interface. In JPL Proceeding of the 17 th Annual Conference on Manual Control. 655--667.Google Scholar
- Abhinav Mehrotra, Mirco Musolesi, Robert Hendley, and Veljko Pejovic. 2015. Designing Content-driven Intelligent Notification Mechanisms for Mobile Applications. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '15). 813--824. Google ScholarDigital Library
- James T Milord and Raymond P Perry. 1977. A Methodological Study of Overloadx. The Journal of General Psychology , Vol. 97, 1 (1977), 131--137.Google ScholarCross Ref
- Darren Newtson and Gretchen Engquist. 1976. The perceptual organization of ongoing behavior. Journal of Experimental Social Psychology , Vol. 12, 5 (1976), 436--450.Google ScholarCross Ref
- Tadashi Okoshi, Julian Ramos, Hiroki Nozaki, Jin Nakazawa, Anind K. Dey, and Hideyuki Tokuda. 2015a. Attelia: Reducing User's Cognitive Load due to Interruptive Notifications on Smart Phones. In Proceedings of IEEE International Conference on Pervasive Computing and Communications 2015 (PerCom '15).Google ScholarCross Ref
- Tadashi Okoshi, Julian Ramos, Hiroki Nozaki, Jin Nakazawa, Anind K. Dey, and Hideyuki Tokuda. 2015b. Reducing Users' Perceived Mental Effort Due to Interruptive Notifications in Multi-device Mobile Environments. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '15). 475--486. Google ScholarDigital Library
- Tadashi Okoshi, Kota Tsubouchi, Masaya Taji, Takanori Ichikawa, and Hideyuki Tokuda. 2017. Attention and Engagement-Awareness in the Wild : A Large-Scale Study with Adaptive Notifications. In Proceedings of IEEE International Conference on Pervasive Computing and Communications 2017 (PerCom '17) . 100--110.Google ScholarCross Ref
- Veljko Pejovic and Mirco Musolesi. 2014. InterruptMe : Designing Intelligent Prompting Mechanisms for Pervasive Applications. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '14). 395--906. Google ScholarDigital Library
- Martin Pielot, Tilman Dingler, Jose San Pedro, and Nuria Oliver. 2015. When Attention is Not Scarce - Detecting Boredom from Mobile Phone Usage. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '15). 825--836. Google ScholarDigital Library
- Benjamin Poppinga, Martin Pielot, Niels Henze, Nuria Oliver, Karen Church, and Alireza Sahami Shirazi. 2015. Smarttention, Please! Intelligent Attention Management on Mobile Devices. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI '15). 1066--1069. Google ScholarDigital Library
- Richard M Shiffrin and Walter Schneider. 1977. Controlled and automatic human information processing: II. Perceptual learning, automatic attending and a general theory. Psychological review , Vol. 84, 2 (1977), 127.Google Scholar
- Herbert A Simon. 1971. Designing organizations for an information-rich world. Computers, communication, and the public interest , Vol. 37 (1971), 40--41.Google Scholar
- Cheri Speier, Joseph S Valacich, and Iris Vessey. 1999. The influence of task interruption on individual decision making: An information overload perspective. Decision Sciences , Vol. 30, 2 (1999), 337--360.Google ScholarCross Ref
- Robert J. Sternberg and Karin Sternberg. 2012. Cognitive Psychology 6 ed.). Cengage Learning.Google Scholar
- G. H. (Henri) ter Hofte. 2007. Xensible Interruptions from Your Mobile Phone. In Proceedings of the 9th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '07). 178--181. Google ScholarDigital Library
- Alvin Toffler. 1990. Future shock .Bantam.Google Scholar
- Kota Tsubouchi and Tadashi Okoshi. 2017. People's Interruptibility In-the-wild: Analysis of Breakpoint Detection Model in a Large-scale Study. In Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers (UbiComp '17). ACM, New York, NY, USA, 922--927. Google ScholarDigital Library
- Alexandra Voit, Benjamin Poppinga, Dominik Weber, Matthias Bo?hmer, Niels Henze, Sven Gehring, Tadashi Okoshi, and Veljko Pejovic. 2016. UbiTtention: Smart & Ambient Notification and Attention Management. In Adjunct Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '16). 1520--1523. Google ScholarDigital Library
- Dominik Weber, Alireza Sahami Shirazi, Sven Gehring, Niels Henze, Benjamin Poppinga, Martin Pielot, and Tadashi Okoshi. 2016. Smarttention, Please!: 2Nd Workshop on Intelligent Attention Management on Mobile Devices. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI '16). 914--917. Google ScholarDigital Library
- Fred RH Zijlstra, Robert A Roe, Anna B Leonora, and Irene Krediet. 1999. Temporal factors in mental work: Effects of interrupted activities. Journal of Occupational and Organizational Psychology , Vol. 72, 2 (1999), 163--185.Google ScholarCross Ref
Index Terms
- Real-World Product Deployment of Adaptive Push Notification Scheduling on Smartphones
Recommendations
Understanding notification stress of smartphone messenger app
CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing SystemsToday, many smartphone users experience stress from receiving notifications all the time. In this work-in-progress paper, we explore the relationships between users' stress levels from receiving smartphone notifications and notification setting ...
Towards end-user development of REST client applications on smartphones
HTML5 can be used to develop client applications by composing REST web services within the context of Web 2.0. However, the possibility of implementing cross-platform smartphone applications with REST services needs to be studied. Accordingly, we ...
DaPanda: detecting aggressive push notifications in Android apps
ASE '19: Proceedings of the 34th IEEE/ACM International Conference on Automated Software EngineeringMobile push notifications have been widely used in mobile platforms to deliver all sorts of information to app users. Although it offers great convenience for both app developers and mobile users, this feature was frequently reported to serve malicious ...
Comments