Sang Ho Yoon
Ke Huo
Subramanian Chidambaram
ABSTRACT
We present iSoft, a single volume soft sensor capable of sensing real-time continuous contact and unidirectional stretching. We propose a low-cost and an easy way to fabricate such piezoresistive elastomer-based soft sensors for instant interactions. We employ an electrical impedance tomography (EIT) technique to estimate changes of resistance distribution on the sensor caused by fingertip contact. To compensate for the rebound elasticity of the elastomer and achieve real-time continuous contact sensing, we apply a dynamic baseline update for EIT. The baseline updates are triggered by fingertip contact and movement detections. Further, we support unidirectional stretching sensing using a model-based approach which works separately with continuous contact sensing. We also provide a software toolkit for users to design and deploy personalized interfaces with customized sensors. Through a series of experiments and evaluations, we validate the performance of contact and stretching sensing. Through example applications, we show the variety of examples enabled by iSoft.
Supplemental Material
- Andy Adler and Robert Guardo. 1996. Electrical impedance tomography: regularized imaging and contrast detection. IEEE Transactions on Medical Imaging 15, 2 (Apr 1996), 170--179.Google Scholar
Cross Ref
- Alamusi, Ning Hu, Hisao Fukunaga, Satoshi Atobe, Yaolu Liu, and Jinhua Li. 2011. Piezoresistive Strain Sensors Made from Carbon Nanotubes Based Polymer Nanocomposites. Sensors 11, 11 (2011), 10691--10723. http://www.mdpi.com/1424--8220/11/11/10691Google ScholarCross Ref
- Hassan Alirezaei, Akihiko Nagakubo, and Yasuo Kuniyoshi. 2007. A highly stretchable tactile distribution sensor for smooth surfaced humanoids. In 2007 7th IEEE-RAS International Conference on Humanoid Robots. 167--173.Google ScholarCross Ref
- Chin-yu Chien, Rong-Hao Liang, Long-Fei Lin, Liwei Chan, and Bing-Yu Chen. 2015. FlexiBend: Enabling Interactivity of Multi-Part, Deformable Fabrications Using Single Shape-Sensing Strip. In Proceedings of the 28th Annual ACM Symposium on User Interface Software and Technology (UIST '15). ACM, NY, NY, USA, 659--663. Google ScholarDigital Library
- Alex Chortos, Jia Liu, and Zhenan Bao. 2016. Pursuing prosthetic electronic skin. Nature Materials 15, 9 (2016), 937--950.Google ScholarCross Ref
- Artem Dementyev, Hsin-Liu (Cindy) Kao, and Joseph A. Paradiso. 2015. SensorTape: Modular and Programmable 3D-Aware Dense Sensor Network on a Tape. In Proceedings of the 28th Annual ACM Symposium on User Interface Software and Technology (UIST '15). ACM, NY, NY, USA, 649--658. Google ScholarDigital Library
- Artem Dementyev and Joseph A. Paradiso. 2014. WristFlex: Low-power Gesture Input with Wrist-worn Pressure Sensors. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, NY, NY, USA, 161--166. Google ScholarDigital Library
- Paul H. Dietz, Benjamin Eidelson, Jonathan Westhues, and Steven Bathiche. 2009. A Practical Pressure Sensitive Computer Keyboard. In Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology (UIST '09). ACM, NY, NY, USA, 55--58. Google ScholarDigital Library
- Peter M. Edic, Gary J. Saulnier, Jonathan C. Newell, and David Isaacson. 1995. A real-time electrical impedance tomograph. IEEE Transactions on Biomedical Engineering 42, 9 (Sept 1995), 849--859.Google ScholarCross Ref
- Marcello Ferro, Giovanni Pioggia, Alessandro Tognetti, Nicola Carbonaro, and Danilo De Rossi. 2009. A Sensing Seat for Human Authentication. IEEE Transactions on Information Forensics and Security 4, 3 (Sept 2009), 451--459. Google ScholarDigital Library
- Sean Follmer, Daniel Leithinger, Alex Olwal, Nadia Cheng, and Hiroshi Ishii. 2012. Jamming User Interfaces: Programmable Particle Stiffness and Sensing for Malleable and Shape-changing Devices. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, NY, NY, USA, 519--528. Google ScholarDigital Library
- Nan-Wei Gong, Jürgen Steimle, Simon Olberding, Steve Hodges, Nicholas Edward Gillian, Yoshihiro Kawahara, and Joseph A. Paradiso. 2014. PrintSense: A Versatile Sensing Technique to Support Multimodal Flexible Surface Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, NY, NY, USA, 1407--1410. Google ScholarDigital Library
- LJ Gray and E Lutz. 1990. On the treatment of corners in the boundary element method. J. Comput. Appl. Math. 32, 3 (1990), 369--386. Google ScholarDigital Library
- Jaehyun Han, Jiseong Gu, and Geehyuk Lee. 2014. Trampoline: A Double-sided Elastic Touch Device for Creating Reliefs. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, NY, NY, USA, 383--388. Google ScholarDigital Library
- PJRC Inc. 2017. Product Detail. (2017). Retrieved April 1, 2017 from http://www.pjrc.com/teensy/index.html.Google Scholar
- Inpil Kang, Mark J Schulz, Jay H Kim, Vesselin Shanov, and Donglu Shi. 2006. A carbon nanotube strain sensor for structural health monitoring. Smart Materials and Structures 15, 3 (2006), 737.Google ScholarCross Ref
- Thorsten Karrer, Moritz Wittenhagen, Leonhard Lichtschlag, Florian Heller, and Jan Borchers. 2011. Pinstripe: Eyes-free Continuous Input on Interactive Clothing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, NY, NY, USA, 1313--1322. Google ScholarDigital Library
- Pasi Kauppinen, Jari Hyttinen, and Jaakko Malmivuo. 2006. Sensitivity distribution visualizations of impedance tomography measurement strategies. International Journal of Bioelectromagnetism 8, 1 (2006), 1--9.Google Scholar
- Yoshihiro Kawahara, Steve Hodges, Benjamin S. Cook, Cheng Zhang, and Gregory D. Abowd. 2013. Instant Inkjet Circuits: Lab-based Inkjet Printing to Support Rapid Prototyping of UbiComp Devices. In Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '13). ACM, NY, NY, USA, 363--372. Google ScholarDigital Library
- Tsz-Ho Kwok, Charlie CL Wang, Dongping Deng, Yunbo Zhang, and Yong Chen. 2015. Four-dimensional printing for freeform surfaces: Design optimization of origami and kirigami structures. Journal of Mechanical Design 137, 11 (2015), 111413.Google ScholarCross Ref
- David Ledo, Fraser Anderson, Ryan Schmidt, Lora Oehlberg, Saul Greenberg, and Tovi Grossman. 2017. Pineal: Bringing Passive Objects to Life with Embedded Mobile Devices. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, NY, NY, USA, 2583--2593. Google ScholarDigital Library
- Joanne Leong, Patrick Parzer, Florian Perteneder, Teo Babic, Christian Rendl, Anita Vogl, Hubert Egger, Alex Olwal, and Michael Haller. 2016. proCover: Sensory Augmentation of Prosthetic Limbs Using Smart Textile Covers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, NY, NY, USA, 335--346. Google ScholarDigital Library
- Jhe-Wei Lin, Chiuan Wang, Yi Yao Huang, Kuan-Ting Chou, Hsuan-Yu Chen, Wei-Luan Tseng, and Mike Y. Chen. 2015. BackHand: Sensing Hand Gestures via Back of the Hand. In Proceedings of the 28th Annual ACM Symposium on User Interface Software and Technology (UIST '15). ACM, NY, NY, USA, 557--564. Google ScholarDigital Library
- Darren J. Lipomi, Michael Vosgueritchian, Benjamin C-K. Tee, Sondra L. Hellstrom, Jennifer A. Lee, Courtney H. Fox, and Zhenan Bao. 2011. Skin-like pressure and strain sensors based on transparent elastic fllms of carbon nanotubes. Nature nanotechnology 6, 12 (2011), 788--792.Google Scholar
- F. Lorussi, Enzo Pasquale Scilingo, M. Tesconi, A. Tognetti, and D. De Rossi. 2005. Strain sensing fabric for hand posture and gesture monitoring. IEEE Transactions on Information Technology in Biomedicine 9, 3 (Sept 2005), 372--381. Google ScholarDigital Library
- Sachi Mizobuchi, Shinya Terasaki, Turo Keski-Jaskari, Jari Nousiainen, Matti Ryynanen, and Miika Silfverberg. 2005. Making an Impression: Force-controlled Pen Input for Handheld Devices. In CHI '05 Extended Abstracts on Human Factors in Computing Systems (CHI EA '05). ACM, NY, NY, USA, 1661--1664. Google ScholarDigital Library
- Vinh P. Nguyen, Sang Ho Yoon, Ansh Verma, and Karthik Ramani. 2014. BendID: Flexible Interface for Localized Deformation Recognition. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '14). ACM, NY, NY, USA, 553--557. Google ScholarDigital Library
- Simon Olberding, Nan-Wei Gong, John Tiab, Joseph A. Paradiso, and Jürgen Steimle. 2013. A Cuttable Multi-touch Sensor. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST '13). ACM, NY, NY, USA, 245--254. Google ScholarDigital Library
- Steve Park, Michael Vosguerichian, and Zhenan Bao. 2013. A review of fabrication and applications of carbon nanotube fllm-based flexible electronics. Nanoscale 5, 5 (2013), 1727--1752.Google ScholarCross Ref
- Yong-Lae Park, Bor-Rong Chen, and Robert J. Wood. 2012. Design and Fabrication of Soft Artificial Skin Using Embedded Microchannels and Liquid Conductors. IEEE Sensors Journal 12, 8 (2012), 2711--2718.Google ScholarCross Ref
- Pedro Piacenza, Yuchen Xiao, Steve Park, Ioannis Kymissis, and Matei Ciocarlie. 2016. Contact localization through spatially overlapping piezoresistive signals. In 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). 195--201.Google ScholarDigital Library
- Ivan Poupyrev, Nan-Wei Gong, Shiho Fukuhara, Mustafa Emre Karagozler, Carsten Schwesig, and Karen E. Robinson. 2016. Project Jacquard: Interactive Digital Textiles at Scale. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, NY, NY, USA, 4216--4227. Google ScholarDigital Library
- Ganna Pugach, Alexandre Pitti, and Philippe Gaussier. 2015. Neural learning of the topographic tactile sensory information of an artificial skin through a self-organizing map. Advanced Robotics 29, 21 (2015), 1393--1409.Google ScholarCross Ref
- Raf Ramakers, Fraser Anderson, Tovi Grossman, and George Fitzmaurice. 2016. RetroFab: A Design Tool for Retrofitting Physical Interfaces Using Actuators, Sensors and 3D Printing. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, NY, NY, USA, 409--419. Google ScholarDigital Library
- Gonzalo Ramos, Matthew Boulos, and Ravin Balakrishnan. 2004. Pressure Widgets. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '04). ACM, NY, NY, USA, 487--494. Google ScholarDigital Library
- Christian Rendl, David Kim, Patrick Parzer, Sean Fanello, Martin Zirkl, Gregor Scheipl, Michael Haller, and Shahram Izadi. 2016. FlexCase: Enhancing Mobile Interaction with a Flexible Sensing and Display Cover. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, NY, NY, USA, 5138--5150. Google ScholarDigital Library
- Peter Roberts, Dana D. Damian, Wanliang Shan, Tong Lu, and Carmel Majidi. 2013. Soft-matter capacitive sensor for measuring shear and pressure deformation. In 2013 IEEE International Conference on Robotics and Automation. 3529--3534.Google ScholarCross Ref
- Ilya Rosenberg and Ken Perlin. 2009. The UnMousePad: An Interpolating Multi-touch Force-sensing Input Pad. In ACM SIGGRAPH 2009 Papers (SIGGRAPH '09). ACM, NY, NY, USA, Article 65, 9 pages. Google ScholarDigital Library
- Valkyrie Savage, Sean Follmer, Jingyi Li, and Björn Hartmann. 2015. Makers' Marks: Physical Markup for Designing and Fabricating Functional Objects. In Proceedings of the 28th Annual ACM Symposium on User Interface Software and Technology (UIST '15). ACM, NY, NY, USA, 103--108. Google ScholarDigital Library
- Martin Schmitz, Mohammadreza Khalilbeigi, Matthias Balwierz, Roman Lissermann, Max Mühlhäuser, and Jürgen Steimle. 2015. Capricate: A Fabrication Pipeline to Design and 3D Print Capacitive Touch Sensors for Interactive Objects. In Proceedings of the 28th Annual ACM Symposium on User Interface Software and Technology (UIST '15). ACM, NY, NY, USA, 253--258. Google ScholarDigital Library
- David Silvera-Tawil, David Rye, Manuchehr Soleimani, and Mari Velonaki. 2015. Electrical Impedance Tomography for Artificial Sensitive Robotic Skin: A Review. IEEE Sensors Journal 15, 4 (April 2015), 2001--2016.Google ScholarCross Ref
- David Silvera-Tawil, David Rye, and Mari Velonaki. 2012. Interpretation of the modality of touch on an artificial arm covered with an EIT-based sensitive skin. The International Journal of Robotics Research 31, 13 (2012), 1627--1641. Google ScholarDigital Library
- Ronit Slyper, Ivan Poupyrev, and Jessica Hodgins. 2011. Sensing Through Structure: Designing Soft Silicone Sensors. In Proceedings of the Fifth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '11). ACM, NY, NY, USA, 213--220. Google ScholarDigital Library
- Yuta Sugiura, Masahiko Inami, and Takeo Igarashi. 2012. A Thin Stretchable Interface for Tangential Force Measurement. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, NY, NY, USA, 529--536. Google ScholarDigital Library
- Raw Material Suppliers. 2017. Print-On Silicone Ink. (2017). Retrieved April 1, 2017 from http: //rawmaterialsuppliers.com/print-on-silicone-rubber.Google Scholar
- Tyler N Tallman, Sila Gungor, K W Wang, and Charles E Bakis. 2015. Damage detection via electrical impedance tomography in glass fiber/epoxy laminates with carbon black filler. Structural Health Monitoring 14, 1 (2015), 100--109.Google ScholarCross Ref
- Karen Vanderloock, Vero Vanden Abeele, Johan A.K. Suykens, and Luc Geurts. 2013. The Skweezee System: Enabling the Design and the Programming of Squeeze Interactions. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST '13). ACM, NY, NY, USA, 521--530. Google ScholarDigital Library
- M Vauhkonen, W R B Lionheart, L M Heikkinen, P J Vauhkonen, and J P Kaipio. 2001. A MATLAB package for the EIDORS project to reconstruct two-dimensional EIT images. Physiological Measurement 22, 1 (2001), 107. http://stacks.iop.org/0967--3334/22/i=1/a=314Google ScholarCross Ref
- Wacker. 2017. ELASTOSIL LR 3162 A/B. (2017). Retrieved April 1, 2017 from http://www.wacker.com.Google Scholar
- Martin Weigel, Tong Lu, Gilles Bailly, Antti Oulasvirta, Carmel Majidi, and Jürgen Steimle. 2015. iSkin: Flexible, Stretchable and Visually Customizable On-Body Touch Sensors for Mobile Computing. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, NY, NY, USA, 2991--3000. Google ScholarDigital Library
- Michael Wessely, Theophanis Tsandilas, and Wendy E. Mackay. 2016. Stretchis: Fabricating Highly Stretchable User Interfaces. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, NY, NY, USA, 697--704. Google ScholarDigital Library
- Takeo Yamada, Yuhei Hayamizu, Yuki Yamamoto, Yoshiki Yomogida, Ali Izadi-Najafabadi, Don N. Futaba, and Kenji Hata. 2011. A stretchable carbon nanotube strain sensor for human-motion detection. Nature Nano 6, 5 (2011), 296--301.Google ScholarCross Ref
- K. Yamaguchi, J. J. C. Busfield, and A. G. Thomas. 2003. Electrical and mechanical behavior of filled elastomers. I. The effect of strain. Journal of Polymer Science Part B: Polymer Physics 41, 17 (2003), 2079--2089.Google ScholarCross Ref
- Lining Yao, Ryuma Niiyama, Jifei Ou, Sean Follmer, Clark Della Silva, and Hiroshi Ishii. 2013. PneUI: Pneumatically Actuated Soft Composite Materials for Shape Changing Interfaces. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST '13). ACM, NY, NY, USA, 13--22. Google ScholarDigital Library
- Sang Ho Yoon, Ke Huo, Vinh P. Nguyen, and Karthik Ramani. 2015. TIMMi: Finger-worn Textile Input Device with Multimodal Sensing in Mobile Interaction. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '15). ACM, NY, NY, USA, 269--272. Google ScholarDigital Library
- Sang Ho Yoon, Yunbo Zhang, Ke Huo, and Karthik Ramani. 2016. TRing: Instant and Customizable Interactions with Objects Using an Embedded Magnet and a Finger-Worn Device. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, NY, NY, USA, 169--181. Google ScholarDigital Library
- Yang Zhang, Gierad Laput, and Chris Harrison. 2017. Electrick: Low-Cost Touch Sensing Using Electric Field Tomography. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, NY, NY, USA, 1--14. Google ScholarDigital Library
- Yang Zhang, Robert Xiao, and Chris Harrison. 2016. Advancing Hand Gesture Recognition with High Resolution Electrical Impedance Tomography. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, NY, NY, USA, 843--850. Google ScholarDigital Library
Index Terms
- iSoft: A Customizable Soft Sensor with Real-time Continuous Contact and Stretching Sensing
Recommendations
HapSense: A Soft Haptic I/O Device with Uninterrupted Dual Functionalities of Force Sensing and Vibrotactile Actuation
UIST '19: Proceedings of the 32nd Annual ACM Symposium on User Interface Software and TechnologyWe present HapSense, a single-volume soft haptic I/O device with uninterrupted dual functionalities of force sensing and vibrotactile actuation. To achieve both input and output functionalities, we employ a ferroelectric electroactive polymer as core ...
MultiSoft: Soft Sensor Enabling Real-Time Multimodal Sensing with Contact Localization and Deformation Classification
We introduce MultiSoft, a multilayer soft sensor capable of sensing real-time contact localization, classification of deformation types, and estimation of deformation magnitudes. We propose a multimodal sensing pipeline that carries out both inverse ...
Mechanical force redistribution: enabling seamless, large-format, high-accuracy surface interaction
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsWe present Mechanical Force Redistribution (MFR): a method of sensing which creates an anti-aliased image of forces applied to a surface. This technique mechanically focuses the force from a surface onto adjacent discrete forcels (force sensing cells) ...
Comments