Abstract
This paper presents an empirical evaluation of the main usability factors that play a significant role in the interaction with on-line Machine Translation (MT) services. The investigation is carried out from the point of view of typical users with an emphasis on their real needs, and focuses on a set of key usability criteria that have an impact on the successful deployment of Internet-based MT technology. A small-scale evaluation of the performance of five popular web-based MT systems against the selected usability criteria shows that different approaches to interaction design can dramatically affect the level of user satisfaction. There are strong indications that the results of this study can be fed back into the development of on-line MT services to enhance their design, thus ensuring that they meet the requirements and expectations of a wide range of Internet users.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Yang, J., Lange, E.: SYSTRAN on AltaVista: A User Study on Real-Time Machine Translation on the Internet. In: Farwell, D., Gerber, L., Hovy, E. (eds.) AMTA 1998. LNCS (LNAI), vol. 1529, pp. 275–285. Springer, Heidelberg (1998)
Hutchins, J.: The Development and Use of Machine Translation Systems and Computerbased Translation Tools. In: Zhaoxiong, C. (ed.) Proceedings of the International Conference on Machine Translation and Computer Language Information Processing, Beijing, China, June 26-28, pp. 1–16 (1999), http://ourworld.compuserve.com/homepages/WJHutchins/Beijing.htm (accessed 14 May 2004)
Miyazawa, S., Yokoyama, S., Matsudaira, M., Kumano, A., Kodama, S., Kashioka, H., Shirokizawa, Y., Nakajima, Y.: Study on Evaluation of WWW MT Systems. In: Proceedings of the Machine Translation Summit VII. MT in the Great Translation Era, Singapore, September 13-17, pp. 290–298 (1999)
Macklovitch, E.: Recent Trends in Translation Technology. In: Proceedings of the 2nd International Conference The Translation Industry Today. Multilingual Documentation, Technology, Market, Bologna, Italy, October 26-28, pp. 23–47 (2001)
O’Connell, T.: Preparing Your Web Site for Machine Translation. How to Avoid Losing (or Gaining) Something in the Translation (2001), http://www-106.ibm.com/developerworks/library/us-mt/?dwzone=usability (accessed 14 May 2004)
Zervaki, T.: Online Free Translation Services. In: Proceedings of the Twenty-fourth International Conference on Translating and the Computer, London. Aslib/IMI, London, November 21-22 (2002)
Yang, J., Lange, E.: Going Live on the Internet. In: Somers, H. (ed.) Computers and Translation. A Translator’s Guide, pp. 191–210. John Benjamins, Amsterdam (2003)
Gaspari, F.: Enhancing Free On-line Machine Translation Services. In: Lee, M. (ed.) Proceedings of the 7th Annual CLUK Research Colloquium, January 6-7, pp. 68–74. University of Birmingham (2004)
Gaspari, F.: Integrating On-line MT Services into Monolingual Web-sites for Dissemination Purposes: an Evaluation Perspective. In: Proceedings of the Ninth EAMT Workshop Broadening Horizons of Machine Translation and Its Applications, April 26-27. Foundation for International Studies, pp. 62–72. University of Malta, Valletta (2004)
Gaspari, F.: Controlled Language, Web Usability and Machine Translation Services on the Internet. In: Blekhman, M. (ed.) International Journal of Translation. A Half-Yearly Review of Translation Studies. Special Number on Machine Translation, January- June 2004, vol. 16(1), pp. 41–54. Bahri Publications, New Delhi (2004)
Nielsen, J.: Designing Web Usability. The Practice of Simplicity. New Riders Publishing, Indiana (2000)
Krug, S.: Don’t Make Me Think. A Common Sense Approach to Web Usability. New Riders Publishing, Indiana (2000)
Nielsen, J., Tahir, M.: Homepage Usability. 50 Websites Deconstructed. New Riders Publishing, Indiana (2002)
Brinck, T., Gergle, D., Wood, S.D.: Designing Web Sites That Work. Usability for the Web. Morgan Kaufmann Publishers, San Francisco (2002)
Jordan, P.W.: An Introduction to Usability. Taylor & Francis, London (1998)
Mowatt, D., Somers, H.: Is MT Software Documentation Appropriate for MT Users? In: White, J.S. (ed.) AMTA 2000. LNCS (LNAI), vol. 1934, pp. 223–238. Springer, Heidelberg (2000)
Sielken, R.: Enabling a Web Site for Machine Translation Using WebSphere Translation Server (2001), http://www7b.boulder.ibm.com/wsdd/library/techarticles/0107_sielken/0107sielken.html (Accessed 14 May 2004)
Trujillo, A.: Translation Engines. Techniques for Machine Translation. Springer, New York (1999)
Expert Advisory Group on Language Engineering Standards (EAGLES): Evaluation of Natural Language Processing Systems Final Report. Technical Report EAG-EWG-PR.2 (Version of October 1996). ISSCO University of Geneva (1996), http://www.issco.unige.ch/projects/ewg96/ewg96.html (- Accessed 14 May 2004)
White, J.S.: Contemplating Automatic MT Evaluation. In: White, J.S. (ed.) AMTA 2000. LNCS (LNAI), vol. 1934, pp. 100–108. Springer, Heidelberg (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Gaspari, F. (2004). Online MT Services and Real Users’ Needs: An Empirical Usability Evaluation. In: Frederking, R.E., Taylor, K.B. (eds) Machine Translation: From Real Users to Research. AMTA 2004. Lecture Notes in Computer Science(), vol 3265. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30194-3_9
Download citation
DOI: https://doi.org/10.1007/978-3-540-30194-3_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-23300-8
Online ISBN: 978-3-540-30194-3
eBook Packages: Springer Book Archive