Abstract
In this paper, we presented an innovative way for a quick and comprehensive evaluation of different online educational websites by following and combining the Web Content Accessibility Guidelines 2.0, the standard ISO/IEC 24751 and heuristic evaluation approach. Five presentative web pages of the Learning Management System eCampus were evaluated by 14 participants classified into two groups with one usability expert in each group. Questionnaires containing twenty-five accessibility questions (=success criteria) were distributed among participants. Each participant was asked to evaluate only up to four success criteria. When completed, usability experts reviewed results and transformed them into final recommendations for improvements. Results revealed that none of five reviewed web pages reached level A for accessibility by the standard Web Content Accessibility Guidelines 2.0. On average, all five web pages reached the score 14 out of 25 in “pass” success criteria. In “fail” success criteria the average score was 4.80. The way of evaluation used in this study suggests possible implications in practice due to its simplicity and quickness.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Batanero, C., Karhu, M., Holvikivi, J., Oton, S., Amado-Salvatierra, H.R.: A method to evaluate accessibility in e-learning education systems. In: Proceedings of the IEEE 14th International Conference on Advanced Learning Technologies (ICALT), Athens, Greece (2014). doi:10.1109/ICALT.2014.163
ISO 9241-171:2008: Ergonomics of Human-System Interaction - Part 171 Guidance on Software Accessibility. International Standard Organization, Geneva (2008)
Bevan, N.: How you could benefit from using ISO standards. In: Proceedings of the Extended Abstracts of the 32nd Annual ACM Conference on Human Factors in Computing Systems. ACM, Toronto (2014)
European Parliament: Proposal for a directive of the European Parliament and of the Council on the accessibility of public sector bodies’ websites (COM(2012)0721 – C7-0394/2012 – 2012/0340(COD)) (2012)
ISO/IEC 24751-1:2008: Information Technology – Individualized Adaptability and Accessibility in E-learning, Education and Training - Part 1: Framework and Reference Model. International Standard Organization, Geneva (2008)
ISO/IEC 24751-2:2008: Information Technology – Individualized Adaptability and Accessibility in E-learning, Education and Training - Part 2: “Access for All” Personal Needs and Preferences for Digital. International Standard Organization, Geneva (2008)
ISO/IEC 24751-3:2008: Information Technology – Individualized Adaptability and Accessibility in E-learning, Education and Training - Part 3: “Access for All” Digital Resource Description. International Standard Organization, Geneva (2008)
ISO/IEC 40500:2012: Information Technology – W3C Web Content Accessibility Guidelines (WCAG) 2.0. International Standard Organization, Geneva (2012)
W3C: Web Content Accessibility Guidelines (WCAG) 2.0. http://www.w3.org/TR/WCAG20/. Accessed 20 December 2014
Mayer, R.E.: Multimedia Learning. Cambridge University Press, New York (2001)
Sweller, J.: Cognitive load during problem solving: effects on learning. Cogn. Sci. 12, 257–285 (1988)
Sullins, J., Craig, S.D., Graesser, A.C.: The influence of modality on deep-reasoning questions. Int. J. Learn. Technol. 5(4), 378–387 (2010)
Nielsen, J.: Finding usability problems through heuristic evaluation. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). ACM Press, New York (1992)
Nielsen, J., Landauer, T.: A mathematical model of the finding of usability problems. In: Proceedings of the ACM/IFIP INTERCHI 1993 Conference. ACM Press, New York (1993)
Nielsen, J.: Usability inspection methods. In: Conference Companion on Human Factors in Computing Systems, pp. 413–414. ACM (1994)
Holzinger, A.: Usability engineering methods for software developers. Commun. ACM 48(1), 71–74 (2005)
Lapuh Bele, J., Hauptman, S., Kožuh, I., Debevc, M.: eCampus as a platform for ubiquitous learning. In: Proceedings of the IEEE Global Engineering Education Conference (EDUCON), Istanbul, Turkey (2014)
Gilbert, T.D., Machin, C.H.C.: Guidelines, icons and marketable skills: an accessibility evaluation of 100 web development company homepages. In: Proceedings of the International Cross-Disciplinary Conference on Web Accessibility (W4A 2012). ACM, New York (2012). doi:10.1145/2207016.2207024
McGrath, L.: What are the Web Content Accessibility Guidelines 2.0? http://www.wuhcag.com/web-content-accessibility-guidelines/. Accessed 20 December 2014
Michailidou, E., Mavrou, K., Zaphiris, P.: eInclusion @ cyprus universities: provision and web accessibility. In: CHI 2012 Extended Abstracts on Human Factors in Computing Systems (CHI EA 2012), pp. 1637–1642. ACM, New York (2012). doi:10.1145/2212776.2223685
WEBAIM: WEBAIM Checklist, WebAIM (Web Accessibility in Mind). http://webaim.org/standards/wcag/checklist. Accessed 20 December 2014
Oud, J.: How well do Ontario library web sites meet new accessibility requirements? Partnership. Can. J. Libr. Inf. Pract. Res. 7(1), 1–17 (2012)
Acknowledgements
This work has been partially supported by the European Union through the Tempus Programme project ECESM – Enhancement of cyber educational system of Montenegro, No: 544088.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Debevc, M., Kožuh, I., Hauptman, S., Klembas, A., Lapuh, J.B., Holzinger, A. (2015). Using WCAG 2.0 and Heuristic Evaluation to Evaluate Accessibility in Educational Web Based Pages. In: Uden, L., Liberona, D., Welzer, T. (eds) Learning Technology for Education in Cloud. LTEC 2015. Communications in Computer and Information Science, vol 533. Springer, Cham. https://doi.org/10.1007/978-3-319-22629-3_16
Download citation
DOI: https://doi.org/10.1007/978-3-319-22629-3_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-22628-6
Online ISBN: 978-3-319-22629-3
eBook Packages: Computer ScienceComputer Science (R0)