| QuickSet: multimodal interaction for distributed applications |
| Full text |
Pdf
(1.65 MB)
|
| Source
|
International Multimedia Conference
archive
Proceedings of the fifth ACM international conference on Multimedia
table of contents
Seattle, Washington, United States
Pages: 31 - 40
Year of Publication: 1997
ISBN:0-89791-991-2
|
|
Authors
|
|
Philip R. Cohen
|
Center for Human Computer Communication, Oregon Graduate Institute of Science and Technology, P.O. Box 91000 Portland, OR
|
|
Michael Johnston
|
Center for Human Computer Communication, Oregon Graduate Institute of Science and Technology, P.O. Box 91000 Portland, OR
|
|
David McGee
|
Center for Human Computer Communication, Oregon Graduate Institute of Science and Technology, P.O. Box 91000 Portland, OR
|
|
Sharon Oviatt
|
Center for Human Computer Communication, Oregon Graduate Institute of Science and Technology, P.O. Box 91000 Portland, OR
|
|
Jay Pittman
|
Center for Human Computer Communication, Oregon Graduate Institute of Science and Technology, P.O. Box 91000 Portland, OR
|
|
Ira Smith
|
Center for Human Computer Communication, Oregon Graduate Institute of Science and Technology, P.O. Box 91000 Portland, OR
|
|
Liang Chen
|
Center for Human Computer Communication, Oregon Graduate Institute of Science and Technology, P.O. Box 91000 Portland, OR
|
|
Josh Clow
|
Center for Human Computer Communication, Oregon Graduate Institute of Science and Technology, P.O. Box 91000 Portland, OR
|
|
| Sponsors |
|
| Publisher |
|
| Bibliometrics |
Downloads (6 Weeks): 15, Downloads (12 Months): 144, Citation Count: 73
|
|
|
REFERENCES
Note: OCR errors may be found in this Reference List extracted from the full text article. ACM has opted to expose the complete List rather than only correct and linked references.
 |
1
|
|
| |
2
|
Baker, M. P., and Wickens, C. D. Human factors in virtual environments for the visual analysis of scientific data. Unpublished ms., University of Illinois.
|
| |
3
|
Brooks, Frederic. 3-D user interfaces: When results matter, Invited presentation (unpublished), UIST'96, Seattle, 1996.
|
| |
4
|
Brison, E. and Vigouroux, N. (unpublished ms.). Multimodal references: A generic fusion process. UR1T-URA CNRS. Universit~ Paul Sabatier, Toulouse, France.
|
| |
5
|
Calder, J. 1987. Typed unification for natural language processing. In E. Klein and J. van Benthem (Eds.), Categories, Polymorphisms, and Unification. Centre for Cognitive Science, University of Edinburgh, Edinburgh, pp. 65-72.
|
| |
6
|
Cheyer, A., and Julia L. 1995. Multimodal maps: An agentbased approach. International Conference on Cooperative Mult#nodal Communication (CMC/95), May I995. Eindhoven, Tile Netherlands. pp. 24-26.
|
| |
7
|
Carpenter, R. 1990. Typed feature structures: Inheritance, (In)equality, and Extensionality. In W. Daelemans and O. Gazdar (Eds.), Proceedings of the 1TK Workshop: Inheritance in Natural Language Processing, Tilburg University, pp. 9-18.
|
| |
8
|
|
| |
9
|
|
| |
10
|
Clarkson, J. D., and Yi, J. LeatherNet: A synthetic forces tactical training system for the USMC commander. Proceedings of the Sixth Conference on Computer Generated Forces and Behavioral Representation. Orlando, Florida, 1996 275-281.
|
 |
11
|
|
 |
12
|
|
| |
13
|
Cohen, P. R., Cheyer, A., Wang, M., and Baeg, S.C. An Open Agent Architecture. Proceedings of the AAAI Spring Symposium Series on Software Agents (March 21-22, Stanford), Stanford Univ., CA, 1994, 1-8.
|
| |
14
|
Courtemanche, A.J. and Ceranowicz, A. ModSAF Development Status. Proceedings of the Fifth Conference on Computer Generated Forces and Behavioral Representation, Univ. Central Florida, Orlando, 1995, 3-13.
|
 |
15
|
|
| |
16
|
Michael Johnston , Philip R. Cohen , David McGee , Sharon L. Oviatt , James A. Pittman , Ira Smith, Unification-based multimodal integration, Proceedings of the eighth conference on European chapter of the Association for Computational Linguistics, p.281-288, July 07-12, 1997, Madrid, Spain
|
| |
17
|
David B. Koons , Carlton J. Sparrell , Kristinn R. Thorisson, Integrating simultaneous input from speech, gaze, and hand gestures, Intelligent multimedia interfaces, American Association for Artificial Intelligence, Menlo Park, CA, 1993
|
| |
18
|
Manke, S., Finke, M., and Waibel, A., The use of dynamic writing information in a connectionist on-line cursive handwriting recognition system, Advances in Neural Information processing Systems 7 (~IIPS), 1994.
|
| |
19
|
R. C. Moore , J. Dowding , H. Bratt , J. M. Gawron , Y. Gorfu , A. Cheyer, CommandTalk: a spoken-language interface for battlefield simulations, Proceedings of the fifth conference on Applied natural language processing, p.1-7, March 31-April 03, 1997, Washington, DC
[doi> 10.3115/974557.974558]
|
 |
20
|
|
| |
21
|
Oviatt, S. L. Pen/Voice: Complementary multimodal communication, Proceedings of SpeechTech'92, New York, February, 1992, 238-241.
|
 |
22
|
|
| |
23
|
Oviatt, S.L. Multimodal interactive maps: Designing for human performance, Human Computer Interaction, in press.
|
 |
24
|
Sharon Oviatt , Antonella DeAngeli , Karen Kuhn, Integration and synchronization of input modes during multimodal human-computer interaction, Proceedings of the SIGCHI conference on Human factors in computing systems, p.415-422, March 22-27, 1997, Atlanta, Georgia, United States
[doi> 10.1145/258549.258821]
|
| |
25
|
Oviatt, S. L., and Olsen, E., Integration themes in multimodal human-computer interaction, Proceedings of the International Conference on Spoken Language Processing, Acoustical Society of Japan, Yokohama, Japan, 1994, 551-554.
|
 |
26
|
|
| |
27
|
Richard Stoakley , Matthew J. Conway , Randy Pausch, Virtual reality on a WIM: interactive worlds in miniature, Proceedings of the SIGCHI conference on Human factors in computing systems, p.265-272, May 07-11, 1995, Denver, Colorado, United States
[doi> 10.1145/223904.223938]
|
| |
28
|
Thorpe, J..4.. The new technology of large scale simulator networking: Implications for mastering the art of warfighting, 9a Interservice Training Systems Conference, 1987, 492-501,
|
| |
29
|
Vo, M. T. and Wood, C. Building an appUeation framework for speech and pen input integration in multimodal learning interfaces. International Conference on Acoustics, Speech, and Signal Processing, Atlanta, GA. 1996.
|
| |
30
|
|
| |
31
|
Wauchope, K. 1994. Eucalyptus: Integrating natural language input with a graphical user interface. Naval Research Laboratory, Report NRL/FR/$510--94-9711,
|
 |
32
|
Michael J. Zyda , David R. Pratt , James G. Monahan , Kalin P. Wilson, NPSNET: constructing a 3D virtual world, Proceedings of the 1992 symposium on Interactive 3D graphics, p.147-156, June 1992, Cambridge, Massachusetts, United States
[doi> 10.1145/147156.147186]
|
CITED BY 73
|
|
Joyce Y. Chai , Pengyu Hong , Michelle X. Zhou, Combining semantic and temporal constraints for multimodal integration in conversation systems, Proceedings of the HLT-NAACL 2003 workshop on Research directions in dialogue processing, p.1-3, May 31, 2003, Edmonton, Alberta, Canada
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Ronnie Taib , Yu Shi , Eric Choi , Fang Chen , Matthew Sladescu , Nhan Phung, Multimodal user interface facilitating critical data entry for traffic incident management, Proceedings of the 2005 NICTA-HCSNet Multimodal User Interaction Workshop, p.55-59, September 13, 2005, Sydney, Australia
|
|
|
|
|
|
|
|
|
|
|
|
David R. McGee , Philip R. Cohen , R. Matthews Wesson , Sheilah Horman, Comparing paper and tangible, multimodal tools, Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, April 20-25, 2002, Minneapolis, Minnesota, USA
|
|
|
|
Ed Kaiser , David Demirdjian , Alexander Gruenstein , Xiaoguang Li , John Niekrasz , Matt Wesson , Sanjeev Kumar, A multimodal learning interface for sketch, speak and point creation of a schedule chart, Proceedings of the 6th international conference on Multimodal interfaces, October 13-15, 2004, State College, PA, USA
|
|
Benfang Xiao , Rebecca Lunsford , Rachel Coulston , Matt Wesson , Sharon Oviatt, Modeling multimodal integration patterns and performance in seniors: toward adaptive processing of individual differences, Proceedings of the 5th international conference on Multimodal interfaces, November 05-07, 2003, Vancouver, British Columbia, Canada
|
|
|
|
Antonio Krüger , Andreas Butz , Christian Müller , Christoph Stahl , Rainer Wasinger , Karl-Ernst Steinberg , Andreas Dirschl, The connected user interface: realizing a personal situated navigation service, Proceedings of the 9th international conference on Intelligent user interface, January 13-16, 2004, Funchal, Madeira, Portugal
|
|
|
|
Ingmar Rauschert , Pyush Agrawal , Rajeev Sharma , Sven Fuhrmann , Isaac Brewer , Alan MacEachren, Designing a human-centered, multimodal GIS interface to support emergency management, Proceedings of the 10th ACM international symposium on Advances in geographic information systems, November 08-09, 2002, McLean, Virginia, USA
|
|
|
|
|
|
|
|
|
|
|
Ed Kaiser , Alex Olwal , David McGee , Hrvoje Benko , Andrea Corradini , Xiaoguang Li , Phil Cohen , Steven Feiner, Mutual disambiguation of 3D multimodal interaction in augmented and virtual reality, Proceedings of the 5th international conference on Multimodal interfaces, November 05-07, 2003, Vancouver, British Columbia, Canada
|
|
|
|
|
|
|
|
|
|
|
Fang Chen , Eric Choi , Julien Epps , Serge Lichman , Natalie Ruiz , Yu Shi , Ronnie Taib , Mike Wu, A study of manual gesture-based selection for the PEMMI multimodal transport management interface, Proceedings of the 7th international conference on Multimodal interfaces, October 04-06, 2005, Torento, Italy
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Paulo Barthelmess , Edward Kaiser , Xiao Huang , David McGee , Philip Cohen, Collaborative multimodal photo annotation over digital paper, Proceedings of the 8th international conference on Multimodal interfaces, November 02-04, 2006, Banff, Alberta, Canada
|
|
|
|
|
|
|
|
Robert Rasch , Alexander Kott , Kenneth D. Forbus, AI on the battlefield: an experimental exploration, Eighteenth national conference on Artificial intelligence, p.906-912, July 28-August 01, 2002, Edmonton, Alberta, Canada
|
|
|
Amanda Stent , John Dowding , Jean Mark Gawron , Elizabeth Owen Bratt , Robert Moore, The CommandTalk spoken dialogue system, Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics, p.183-190, June 20-26, 1999, College Park, Maryland
|
|
|
David M. Krum , Olugbenga Omoteso , William Ribarsky , Thad Starner , Larry F. Hodges, Evaluation of a multimodal interface for 3D terrain visualization, Proceedings of the conference on Visualization '02, October 27-November 01, 2002, Boston, Massachusetts
|
|
|
|
|
|
Joyce Y. Chai , Zahar Prasov , Joseph Blaim , Rong Jin, Linguistic theories in efficient multimodal reference resolution: an empirical investigation, Proceedings of the 10th international conference on Intelligent user interfaces, January 10-13, 2005, San Diego, California, USA
|
|
|
David M. Krum , Olugbenga Omoteso , William Ribarsky , Thad Starner , Larry F. Hodges, Speech and gesture multimodal control of a whole Earth 3D visualization environment, Proceedings of the symposium on Data Visualisation 2002, May 27-29, 2002, Barcelona, Spain
|
|
Kenneth D. Forbus , Ronald W. Ferguson , Jeffery M. Usher, Towards a computational model of sketching, Proceedings of the 6th international conference on Intelligent user interfaces, p.77-83, January 14-17, 2001, Santa Fe, New Mexico, United States
|
|
|
|
Rémi Bastide , David Navarre , Philippe Palanque , Amélie Schyn , Pierre Dragicevic, A model-based approach for real-time embedded multimodal systems in military aircrafts, Proceedings of the 6th international conference on Multimodal interfaces, October 13-15, 2004, State College, PA, USA
|
|
|
Rajeev Sharma , Michael Zeller , Vladimir I. Pavlovic , Thomas S. Huang , Zion Lo , Stephen Chu , Yunxin Zhao , James C. Phillips , Klaus Schulten, Speech/Gesture Interface to a Visual-Computing Environment, IEEE Computer Graphics and Applications, v.20 n.2, p.29-37, March 2000
|
|
|
|
|
R. Y. Fu , H. Su , J. C. Fletcher , W. Li , X. X. Liu , S. W. Zhao , C. Y. Chi, A framework for device capability on demand and virtual device user experience, IBM Journal of Research and Development, v.48 n.5/6, p.635-648, September/November 2004
|
|
Paulo Barthelmess , Edward Kaiser , Rebecca Lunsford , David McGee , Philip Cohen , Sharon Oviatt, Human-centered collaborative interaction, Proceedings of the 1st ACM international workshop on Human-centered multimedia, October 27-27, 2006, Santa Barbara, California, USA
|
|
|
Joyce Y. Chai , Pengyu Hong , Michelle X. Zhou , Zahar Prasov, Optimization in multimodal interpretation, Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics, p.1-es, July 21-26, 2004, Barcelona, Spain
|
|
Matthias Jöst , Jochen Häußler , Matthias Merdes , Rainer Malaka, Multimodal interaction for pedestrians: an evaluation study, Proceedings of the 10th international conference on Intelligent user interfaces, January 10-13, 2005, San Diego, California, USA
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Zouheir Trabelsi , Sung-Hyuk Cha , Darshan Desai , Charles Tappert, A voice and ink XML multimodal architecture for mobile e-commerce systems, Proceedings of the 2nd international workshop on Mobile commerce, September 28-28, 2002, Atlanta, Georgia, USA
|
|
|
|
Andrea Corradini , Manish Mehta , Niels-Ole Bernsen , Marcela Charfuelan, Animating an interactive conversational character for an educational game system, Proceedings of the 10th international conference on Intelligent user interfaces, January 10-13, 2005, San Diego, California, USA
|
|
|
|
|
|
|
|
|
INDEX TERMS
Primary Classification:
I.
Computing Methodologies
I.2
ARTIFICIAL INTELLIGENCE
I.2.7
Natural Language Processing
Subjects:
Speech recognition and synthesis
Additional Classification:
H.
Information Systems
H.5
INFORMATION INTERFACES AND PRESENTATION (I.7)
I.
Computing Methodologies
I.6
SIMULATION AND MODELING
General Terms:
Design,
Human Factors,
Languages,
Management,
Performance,
Theory
Keywords:
agent architecture,
distributed interactive simulation,
gesture recognition,
multimodal interfaces,
natural language processing,
speech recognition
Peer to Peer - Readers of this Article have also read:
-
M4: a metamodel for data preprocessing
Proceedings of the 4th ACM international workshop on Data warehousing and OLAP
Anca Vaduva
, Jörg-Uwe Kietz
, Regina Zücker
-
Inferring constraints from multiple snapshots
ACM Transactions on Graphics (TOG)
12, 4
David Kurlander
, Steven Feiner
-
Data structures for quadtree approximation and compression
Communications of the ACM
28, 9
Hanan Samet
-
A hierarchical single-key-lock access control using the Chinese remainder theorem
Proceedings of the 1992 ACM/SIGAPP Symposium on Applied computing
Kim S. Lee
, Huizhu Lu
, D. D. Fisher
-
Putting innovation to work: adoption strategies for multimedia communication systems
Communications of the ACM
34, 12
Ellen Francik
, Susan Ehrlich Rudman
, Donna Cooper
, Stephen Levine
|