Sauvik Das
Jason I. Hong
ABSTRACT
Many accounts and devices require only infrequent authentication by an individual, and thus authentication secrets should be both secure and memorable without much reinforcement. Inspired by people's strong visual-spatial memory, we introduce a novel system to help address this problem: the Memory Palace. The Memory Palace encodes authentication secrets as paths through a 3D virtual labyrinth navigated in the first-person perspective. We ran two experiments to iteratively design and evaluate the Memory Palace. In the first, we found that visual-spatial secrets are most memorable if navigated in a 3D first-person perspective. In the second, we comparatively evaluated the Memory Palace against Android's 9-dot pattern lock along three dimensions: memorability after one week, resilience to shoulder surfing, and speed. We found that relative to 9-dot, complexity-controlled secrets in the Memory Palace were significantly more memorable after one week, were much harder to break through shoulder surfing, and were not significantly slower to enter.
Supplemental Material
Available for Download
srt
ufp6386pvc.srt (782 B)
Preview video captions
srt
ufp6386vfc.srt (782 B)
Video figure captions
zip
ufp6386aux.zip (6.6 MB)
This folder contains supplementary materials for our UIST'19 paper, The Memory Palace: Exploring Visual-Spatial Paths for Strong, Memorable, Infrequent Authentication. We include three supplementary files. - ots_9dot.mp4 consists of the "over-the-shoulder" perspective video of someone entering their 9-dot secret for participants to attempt to break in Study 2. - ots_mempal.mp4 consists of the same for someone entering their Memory Palace secret in study 2. - InMemoriam_TaehoonLee.pdf is a dedication to one our co-authors who, unfortunately, passed away before this paper could be published.
- Acu-Rite. 2019. MILLPWR G2 Control Systems. (2019). https://acu-rite.com/millpwr-control-systems.html.Google Scholar
- Harshit Agrawal, Udayan Umapathi, Robert Kovacs, Johannes Frohnhofen, Hsiang-Ting Chen, Stefanie Mueller, and Patrick Baudisch. 2015. Protopiper: Physically Sketching Room-Sized Objects at Actual Scale. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST '15). ACM, New York, NY, USA, 427--436. DOI: http://dx.doi.org/10.1145/2807442.2807505Google ScholarDigital Library
- David Anderson, James L. Frankel, Joe Marks, Aseem Agarwala, Paul Beardsley, Jessica Hodgins, Darren Leigh, Kathy Ryall, Eddie Sullivan, and Jonathan S. Yedidia. 2000. Tangible Interaction + Graphical Interpretation: A New Approach to 3D Modeling. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '00). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 393--402. DOI: http://dx.doi.org/10.1145/344779.344960Google Scholar
- Akash Badshah, Sidhant Gupta, Daniel Morris, Shwetak Patel, and Desney Tan. 2012. GyroTab: A Handheld Device That Provides Reactive Torque Feedback. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 3153--3156. DOI: http://dx.doi.org/10.1145/2207676.2208731Google ScholarDigital Library
- Hrvoje Benko, Christian Holz, Mike Sinclair, and Eyal Ofek. 2016. NormalTouch and TextureTouch: High-fidelity 3D Haptic Shape Rendering on Handheld Virtual Reality Controllers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 717--728. DOI: http://dx.doi.org/10.1145/2984511.2984526Google ScholarDigital Library
- Inrak Choi, Heather Culbertson, Mark R. Miller, Alex Olwal, and Sean Follmer. 2017. Grabity: A Wearable Haptic Interface for Simulating Weight and Grasping in Virtual Reality. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 119--130. DOI: http://dx.doi.org/10.1145/3126594.3126599Google ScholarDigital Library
- Laura Devendorf, Abigail De Kosnik, Kate Mattingly, and Kimiko Ryokai. 2016. Probing the Potential of Post-Anthropocentric 3D Printing. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (DIS '16). ACM, New York, NY, USA, 170--181. DOI: http://dx.doi.org/10.1145/2901790.2901879Google ScholarDigital Library
- Laura Devendorf and Kimiko Ryokai. 2015. Being the Machine: Reconfiguring Agency and Control in Hybrid Fabrication. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2477--2486. DOI:http://dx.doi.org/10.1145/2702123.2702547Google ScholarDigital Library
- Sean Follmer, David Carr, Emily Lovell, and Hiroshi Ishii. 2010. CopyCAD: Remixing Physical Objects with Copy and Paste from the Real World. In Adjunct Proceedings of the 23Nd Annual ACM Symposium on User Interface Software and Technology (UIST '10). ACM, New York, NY, USA, 381--382. DOI: http://dx.doi.org/10.1145/1866218.1866230Google ScholarDigital Library
- Chris Fox. 2016. A Little More Conversation(al). (Nov. 2016). https: //www.tormach.com/blog/a-little-more-conversational/Google Scholar
- Madeline Gannon, Tovi Grossman, and George Fitzmaurice. 2016. ExoSkin: On-Body Fabrication. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 5996--6007. DOI: http://dx.doi.org/10.1145/2858036.2858576Google ScholarDigital Library
- David J. Gingery. 2014. The Metal Lathe. David J. Gingery Publishing, LLC, Kimberling City, MO, USA.Google Scholar
- Sidhant Gupta, Tim Campbell, Jeffrey R. Hightower, and Shwetak N. Patel. 2010. SqueezeBlock: Using Virtual Springs in Mobile Devices for Eyes-free Interaction. In Proceedings of the 23Nd Annual ACM Symposium on User Interface Software and Technology (UIST '10). ACM, New York, NY, USA, 101--104. DOI: http://dx.doi.org/10.1145/1866029.1866046Google Scholar
- Haas. 2017. Haas Electronic Handwheels. (2017). https://www.haascnc.com/productivity/product-options/ e-handwheels.html.Google Scholar
- Blake Hannaford and Allison M. Okamura. 2008. Haptics. In Springer Handbook of Robotics, Bruno Siciliano and Oussama Khatib (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 719--739. DOI: http://dx.doi.org/10.1007/978--3--540--30301--5_31Google Scholar
- Studio Homunculus. 2011. Haptic Intelligentsia. (2011). http://studio-homunculus.com/portfolio/ haptic-intelligentsia-human-prototyping-machine/Google Scholar
- Jeeeun Kim, Clement Zheng, Haruki Takahashi, Mark D Gross, Daniel Ashbrook, and Tom Yeh. 2018. Compositional 3D Printing: Expanding & Supporting Workflows Towards Continuous Fabrication. In Proceedings of the 2Nd ACM Symposium on Computational Fabrication (SCF '18). ACM, New York, NY, USA, 5:1--5:10. DOI: http://dx.doi.org/10.1145/3213512.3213518Google ScholarDigital Library
- Scott R. Klemmer, Björn Hartmann, and Leila Takayama. 2006. How Bodies Matter: Five Themes for Interaction Design. In Proceedings of the 6th Conference on Designing Interactive Systems (DIS '06). ACM, New York, NY, USA, 140--149. DOI: http://dx.doi.org/10.1145/1142405.1142429Google ScholarDigital Library
- Jay Lee, Victor Su, Sandia Ren, and Hiroshi Ishii. 2000. HandSCAPE: A Vectorizing Tape Measure for On-site Measuring Applications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '00). ACM, New York, NY, USA, 137--144. DOI: http://dx.doi.org/10.1145/332040.332417Google ScholarDigital Library
- Danny Leen, Raf Ramakers, and Kris Luyten. 2017. StrutModeling: A Low-Fidelity Construction Kit to Iteratively Model, Test, and Adapt 3D Objects. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 471--479. DOI: http://dx.doi.org/10.1145/3126594.3126643Google ScholarDigital Library
- Jingyi Li, Jennifer Jacobs, Michelle Chang, and Björn Hartmann. 2017. Direct and Immediate Drawing with CNC Machines. In Proceedings of the 1st Annual ACM Symposium on Computational Fabrication (SCF '17). ACM, New York, NY, USA, 11:1--11:2. DOI: http://dx.doi.org/10.1145/3083157.3096344Google ScholarDigital Library
- Koichi Morishige and Miharu Nakada. 2016. Development of Turning Machine Operation Interface that Uses Haptic Device (Application to Complicated Cutting by Special Byte). Procedia CIRP 57 (Jan. 2016), 649--652. DOI: http://dx.doi.org/10.1016/j.procir.2016.11.112Google Scholar
- Stefanie Mueller, Sangha Im, Serafima Gurevich, Alexander Teibrich, Lisa Pfisterer, François Guimbretière, and Patrick Baudisch. 2014. WirePrint: 3D Printed Previews for Fast Prototyping. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, New York, NY, USA, 273--280. DOI: http://dx.doi.org/10.1145/2642918.2647359Google ScholarDigital Library
- Stefanie Mueller, Bastian Kruck, and Patrick Baudisch. 2013. LaserOrigami: Laser-cutting 3D Objects. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 2585--2592. DOI: http://dx.doi.org/10.1145/2470654.2481358Google ScholarDigital Library
- Stefanie Mueller, Pedro Lopes, and Patrick Baudisch. 2012. Interactive Construction: Interactive Fabrication of Functional Mechanical Devices. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, New York, NY, USA, 599--606. DOI: http://dx.doi.org/10.1145/2380116.2380191Google ScholarDigital Library
- David F. Noble. 1986. Forces of Production: A Social History of Industrial Automation. Oxford University Press, Oxford, England, UK.Google Scholar
- Alex Olwal, Jonny Gustafsson, and Christoffer Lindfors. 2008. Spatial augmented reality on industrial CNC-machines. In The Engineering Reality of Virtual Reality 2008, Vol. 6804. International Society for Optics and Photonics, San Jose, California, USA, 680409. DOI: http://dx.doi.org/10.1117/12.760960Google ScholarCross Ref
- Huaishu Peng, Jimmy Briggs, Cheng-Yao Wang, Kevin Guo, Joseph Kider, Stefanie Mueller, Patrick Baudisch, and François Guimbretière. 2018. RoMA: Interactive Fabrication with Augmented Reality and a Robotic 3D Printer. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, 579:1--579:12. DOI: http://dx.doi.org/10.1145/3173574.3174153Google ScholarDigital Library
- Huaishu Peng, Rundong Wu, Steve Marschner, and François Guimbretière. 2016. On-The-Fly Print: Incremental Printing While Modelling. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 887--896. DOI: http://dx.doi.org/10.1145/2858036.2858106Google ScholarDigital Library
- Huaishu Peng, Amit Zoran, and François V. Guimbretière. 2015. D-Coil: A Hands-on Approach to Digital 3D Models Design. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 1807--1815. DOI: http://dx.doi.org/10.1145/2702123.2702381Google Scholar
- W. J. Plesniak, R. S. Pappu, and S. A. Benton. 2003. Haptic holography: a primitive computational plastic. Proc. IEEE 91, 9 (Sept. 2003), 1443--1456. DOI: http://dx.doi.org/10.1109/JPROC.2003.817129Google ScholarCross Ref
- C. J. Ploch, J. H. Bae, W. Ju, and M. Cutkosky. 2016. Haptic skin stretch on a steering wheel for displaying preview information in autonomous cars. In 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, Daejeon, Korea, 60--65. DOI: http://dx.doi.org/10.1109/IROS.2016.7759035Google ScholarDigital Library
- Michael Polanyi. 1967. The tacit dimension. Anchor Books, Garden City, N.Y. OCLC: 718091.Google Scholar
- Z. F. Quek, S. B. Schorr, I. Nisky, W. R. Provancher, and A. M. Okamura. 2015. Sensory Substitution and Augmentation Using 3-Degree-of-Freedom Skin Deformation Feedback. IEEE Transactions on Haptics 8, 2 (April 2015), 209--221. DOI: http://dx.doi.org/10.1109/TOH.2015.2398448Google ScholarDigital Library
- Alec Rivers, Andrew Adams, and Frédo Durand. 2012a. Sculpting by Numbers. ACM Trans. Graph. 31, 6 (Nov. 2012), 157:1--157:7. DOI: http://dx.doi.org/10.1145/2366145.2366176Google ScholarDigital Library
- Alec Rivers, Ilan E. Moyer, and Frédo Durand. 2012b. Position-correcting Tools for 2D Digital Fabrication. ACM Trans. Graph. 31, 4 (July 2012), 88:1--88:7. DOI: http://dx.doi.org/10.1145/2185520.2185584Google ScholarDigital Library
- L. T. C. Rolt. 1965. A short history of machine tools. M.I.T. Press, Cambridge, MA, USA.Google Scholar
- Eldon Schoop, Michelle Nguyen, Daniel Lim, Valkyrie Savage, Sean Follmer, and Björn Hartmann. 2016. Drill Sergeant: Supporting Physical Construction Projects Through an Ecosystem of Augmented Tools. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16). ACM, New York, NY, USA, 1607--1614. DOI:http://dx.doi.org/10.1145/2851581.2892429Google ScholarDigital Library
- Roy Shilkrot, Pattie Maes, Joseph A. Paradiso, and Amit Zoran. 2015. Augmented Airbrush for Computer Aided Painting (CAP). ACM Trans. Graph. 34, 2 (March 2015), 19:1--19:11. DOI:http://dx.doi.org/10.1145/2699649Google ScholarDigital Library
- Hyunyoung Song, François Guimbretière, Chang Hu, and Hod Lipson. 2006. ModelCraft: Capturing Freehand Annotations and Edits on Physical 3D Models. In Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology (UIST '06). ACM, New York, NY, USA, 13--22. DOI: http://dx.doi.org/10.1145/1166253.1166258Google ScholarDigital Library
- Alexander Teibrich, Stefanie Mueller, François Guimbretière, Robert Kovacs, Stefan Neubert, and Patrick Baudisch. 2015. Patching Physical Objects. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST '15). ACM, New York, NY, USA, 83--91. DOI: http://dx.doi.org/10.1145/2807442.2807467Google ScholarDigital Library
- Rundong Tian, Sarah Sterman, Ethan Chiou, Jeremy Warner, and Eric Paulos. 2018. MatchSticks: Woodworking Through Improvisational Digital Fabrication. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, 149:1--149:12. DOI: http://dx.doi.org/10.1145/3173574.3173723Google ScholarDigital Library
- Cesar Torres, Wilmot Li, and Eric Paulos. 2016. ProxyPrint: Supporting Crafting Practice Through Physical Computational Proxies. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (DIS '16). ACM, New York, NY, USA, 158--169. DOI: http://dx.doi.org/10.1145/2901790.2901828Google ScholarDigital Library
- Christian Weichel, Jason Alexander, Abhijit Karnik, and Hans Gellersen. 2015a. SPATA: Spatio-Tangible Tools for Fabrication-Aware Design. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '15). ACM, New York, NY, USA, 189--196. DOI: http://dx.doi.org/10.1145/2677199.2680576Google ScholarDigital Library
- Christian Weichel, John Hardy, Jason Alexander, and Hans Gellersen. 2015b. ReForm: Integrating Physical and Digital Design Through Bidirectional Fabrication. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST '15). ACM, New York, NY, USA, 93--102. DOI: http://dx.doi.org/10.1145/2807442.2807451Google ScholarDigital Library
- Christian Weichel, Manfred Lau, David Kim, Nicolas Villar, and Hans W. Gellersen. 2014. MixFab: A Mixed-reality Environment for Personal Fabrication. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 3855--3864. DOI: http://dx.doi.org/10.1145/2556288.2557090Google ScholarDigital Library
- Karl D.D. Willis, Juncong Lin, Jun Mitani, and Takeo Igarashi. 2010. Spatial Sketch: Bridging Between Movement & Fabrication. In Proceedings of the Fourth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '10). ACM, New York, NY, USA, 5--12. DOI: http://dx.doi.org/10.1145/1709886.1709890Google ScholarDigital Library
- Karl D.D. Willis, Cheng Xu, Kuan-Ju Wu, Golan Levin, and Mark D. Gross. 2011. Interactive Fabrication: New Interfaces for Digital Fabrication. In Proceedings of the Fifth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '11). ACM, New York, NY, USA, 69--72. DOI: http://dx.doi.org/10.1145/1935701.1935716Google ScholarDigital Library
- Junichi Yamaoka and Yasuaki Kakehi. 2013. dePENd: Augmented Handwriting System Using Ferromagnetism of a Ballpoint Pen. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST '13). ACM, New York, NY, USA, 203--210. DOI: http://dx.doi.org/10.1145/2501988.2502017Google ScholarDigital Library
- Mayu M. Yamashita, Junichi Yamaoka, and Yasuaki Kakehi. 2013. Enchanted Scissors: A Scissor Interface for Support in Cutting and Interactive Fabrication. In ACM SIGGRAPH 2013 Posters (SIGGRAPH '13). ACM, New York, NY, USA, 33:1--33:1. DOI: http://dx.doi.org/10.1145/2503385.2503422Google ScholarDigital Library
- Amit Zoran and Joseph A. Paradiso. 2013. FreeD: A Freehand Digital Sculpting Tool. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 2613--2616. DOI: http://dx.doi.org/10.1145/2470654.2481361Google ScholarDigital Library
- A. Zoran, R. Shilkrot, P. Goyal, P. Maes, and J. A. Paradiso. 2014. The Wise Chisel: The Rise of the Smart Handheld Tool. IEEE Pervasive Computing 13, 3 (July 2014), 48--57. DOI: http://dx.doi.org/10.1109/MPRV.2014.59Google ScholarCross Ref
Index Terms
- The Memory Palace: Exploring Visual-Spatial Paths for Strong, Memorable, Infrequent Authentication
Recommendations
NeverMind: Using Augmented Reality for Memorization
UIST '16 Adjunct: Adjunct Proceedings of the 29th Annual ACM Symposium on User Interface Software and TechnologyNeverMind is an interface and application designed to support human memory. We combine the memory palace memorization method with augmented reality technology to create a tool to help anyone memorize more effectively. Preliminary experiments show that ...
Memory retrieval and graphical passwords
SOUPS '13: Proceedings of the Ninth Symposium on Usable Privacy and SecurityGraphical passwords are an alternative form of authentication that use images for login, and leverage the picture superiority effect for good usability and memorability. Categories of graphical passwords have been distinguished on the basis of different ...
PassPoints: design and longitudinal evaluation of a graphical password system
Special isssue: HCI research in privacy and security is critical nowComputer security depends largely on passwords to authenticate human users. However, users have difficulty remembering passwords over time if they choose a secure password, i.e. a password that is long and random. Therefore, they tend to choose short ...
Comments