Sonia Baltodano
Nikolas Martelaro
Nikhil Gowda
Wendy Ju
ABSTRACT
This platform paper introduces a methodology for simulating an autonomous vehicle on open public roads. The paper outlines the technology and protocol needed for running these simulations, and describes an instance where the Real Road Autonomous Driving Simulator (RRADS) was used to evaluate 3 prototypes in a between-participant study design. 35 participants were interviewed at length before and after entering the RRADS. Although our study did not use overt deception---the consent form clearly states that a licensed driver is operating the vehicle---the protocol was designed to support suspension of disbelief. Several participants who did not read the consent form clearly strongly believed that they were interacting with a fully autonomous vehicle.
The RRADS platform provides a lens onto the attitudes and concerns that people in real-world autonomous vehicles might have, and also points to ways that a protocol deliberately using misdirection can gain ecologically valid reactions from study participants.
- Alpern, M., & Minardo, K. (2003). Developing a car gesture interface for use as a secondary task. In Extended abstracts on Human factors in computing systems (CHI'03), 932--933. Google Scholar
Digital Library
- Baltodano, S., Sibi, S., Martelaro, N., Gowda, N., & Ju, W.(2015). RRADS: Real Road Autonomous Driving Simulation. In Extended Abstracts of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction (HRI'15), 283--284. Google ScholarDigital Library
- Baum, L. F. (1900). The wonderful wizard of Oz. Books of Wonder.Google Scholar
- Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative research in psychology, 3 (2), 77--101.Google Scholar
- Burgess, M., King, N., Harris, M., & Lewis, E. (2013). Electric vehicle drivers' reported interactions with the public: Driving stereotype change? Transportation Research Pt F: Traffic Psychology, 17, 33--44.Google ScholarCross Ref
- Cross, N (1977). The Automated Architect. Pion Limited. Google ScholarDigital Library
- Dahlbäck, N., Jönsson, A., & Ahrenberg, L. (1993). Wizard of Oz studies---why and how. Knowledge-based systems, 6(4), 258--266.Google Scholar
- Davies, A. (2015.) I Rode 500 Miles in a Self-Driving Car and Saw the Future. It's Delightfully Dull. Wired.com, January 7, 2025. Available at: http://www.wired.com/2015/01/rode-500-miles-self-driving-car-saw-future-boring/Google Scholar
- Elo, S., & Kyngäs, H. (2008). The qualitative content analysis process. J. Advanced Nursing, 62(1), 107--115.Google ScholarCross Ref
- Fels, S., Hausch, R., & Tang, A. (2006). Investigation of haptic feedback in the driver seat. In IEEE Intelligent Transportation Systems Conference (ITSC'06), 584--589.Google ScholarCross Ref
- Fitch, G. M., Kiefer, R. J., Hankey, J. M., & Kleiner, B. M.(2007). Toward developing an approach for alerting drivers to the direction of a crash threat. Human Factors: The Journal of the Human Factors and Ergonomics Society, 49(4), 710--720.Google ScholarCross Ref
- Fitch, G. M., Hankey, J. M., Kleiner, B. M., & Dingus, T. A.(2011). Driver comprehension of multiple haptic seat alerts intended for use in an integrated collision avoidance system. Transportation Research part F: Traffic Psychology and Behaviour, 14(4), 278--290.Google ScholarCross Ref
- Geiger, M., Nieschulz, R., Zobl, M., Neuss, R., & Lang, M.(2001). Methods for Facilitation of Wizard-of-Oz Studies and Data Acquisition. In Proc. of the 9th Intl. Conf. on Human-Computer Interaction (HCI International 2001), New Orleans, Louisiana, USA, 5(10), 8--11.Google Scholar
- Geutner, P., Steffens, F., & Manstetten, D. (2002). Design of the VICO Spoken Dialogue System: Evaluation of User Expectations by Wizard-of-Oz Experiments. In Proc. Third International Conference on Language Resources and Evaluation (LREC'02). 1588--1593.Google Scholar
- Green, P., Boreczky, J., and Kim, S. (1990). Applications of Rapid Prototyping to Control and Display Design. SAE Technical Paper 900470., doi:10.4271/900470.Google Scholar
- Hogema, J. H., De Vries, S. C., Van Erp, J., & Kiefer, R. J.(2009). A tactile seat for direction coding in car driving: Field evaluation. In Proc. of IEEE Transactions on Haptics, 2(4), 181--188. Google ScholarDigital Library
- Kelley, J. F. (1983) An empirical methodology for writing user-friendly natural language computer applications. Proceedings of ACM Human Factors in Computing systems (CHI'83), 193--196. Google ScholarDigital Library
- Kelley, J. F. (1985). CAL -- A Natural Language program developed with the OZ Paradigm: Implications for Supercomputing Systems".." In Proceedings of ACM First International Conference on Supercomputing Systems. 238--248.Google Scholar
- Lathrop, B., Cheng, H., Weng, F., Mishra, R., Chen, J., Bratt, H., & Shriberg, L. (2005). A Wizard of Oz framework for collecting spoken human-computer dialogs: An experiment procedure for the design and testing of natural language in-vehicle technology systems. In Proc. 12th World Congress on Intelligent Transportation Systems (ITS'05), 12(6) 3298--307.Google Scholar
- Morrell, J., & Wasilewski, K. (2010). Design and evaluation of a vibrotactile seat to improve spatial awareness while driving. In Proc. IEEE Haptics Symposium, 281--288. Google ScholarDigital Library
- Schmidt, G., Kiss, M., Babbel, E., & Galla, A. (2008). The Wizard on Wheels: Rapid Prototyping and User Testing of Future Driver Assistance Using Wizard of Oz Technique in a Vehicle. In Proceedings of the FISITA 2008 World Automotive Congress, Munich. F2008-02-001Google Scholar
- Schuller, B., Lang, M., & Rigoll, G. (2006). Recognition of spontaneous emotions by speech within automotive environment. Fortschritte der Akustik (DAGA'06), 32(1), 57--8.Google Scholar
- Talone, A., Fincannon, T., Schuster, D., Jentsch, F. and Hudson, I. (2013). Comparing Physical and Virtual Simulation Use in UGV Research. Proc. of the Human Factors and Ergonomics Society (HFES'13), 57(1), 2017--202.Google ScholarCross Ref
Index Terms
- The RRADS platform: a real road autonomous driving simulator
Recommendations
RRADS: Real Road Autonomous Driving Simulation
HRI'15 Extended Abstracts: Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction Extended AbstractsThis video introduces a methodology for simulating an autonomous vehicle on open public roads. The video showcases participant reaction footage collected in the RRADS (Real Road Autonomous Driving Simulator). Although our study using this simulator did ...
Ghost driver: a platform for investigating interactions between pedestrians and driverless vehicles
AutomotiveUI '15: Adjunct Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular ApplicationsHow will pedestrians and cyclists interact with self-driving cars when there is no human driver? To find answers to this question we need a secure experimental design in which pedestrians can interact with a car that appears to drive on its own. In ...
On-Road and Online Studies to Investigate Beliefs and Behaviors of Netherlands, US and Mexico Pedestrians Encountering Hidden-Driver Vehicles
HRI '20: Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot InteractionA growing number of studies use a "ghost-driver" vehicle driven by a person in a car seat costume to simulate an autonomous vehicle. Using a hidden-driver vehicle in a field study in the Netherlands, Study 1 (N = 130) confirmed that the ghostdriver ...
Comments