Skip to main content

Advertisement

Log in

Development and validation of the educational technologist multimedia competency survey

  • Research Article
  • Published:
Educational Technology Research and Development Aims and scope Submit manuscript

Abstract

The purpose of this research study was to identify the multimedia competencies of an educational technologist by creating a valid and reliable survey instrument to administer to educational technology professionals. The educational technology multimedia competency survey developed through this research is based on a conceptual framework that emphasizes the current definition of the field. Following the conceptual framework, a review of literature and an emergent theme analysis on 205 job announcements in educational technology were conducted. Eighty-five multimedia competencies were derived from this analysis and organized into knowledge, skill, and ability statements. These data were examined using descriptive statistics, internal consistency reliability, exploratory factor analysis, and multivariate analysis of variance. Though the purpose of the instrument was to measure multimedia competencies relevant to the field of educational technology, other constructs on the instrument emerged as more important in the analysis. The results include key competencies, such as knowledge of methods and theories of instruction; soft skills; and the ability to work in a team-oriented environment. A discussion about the results is provided. The instrument was found to have a valid and internally consistent structure.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

References

  • Alessi, S., & Trollip, S. (2001). Multimedia for learning; methods and development (3rd ed.). Boston, MA: Pearson Education.

    Google Scholar 

  • Allen, I. E., & Seaman, J. (2013). Changing course: Ten years of tracking online education in the United States. Wellesley, MA: Babson College.

  • American Society for Training and Development (ASTD). (2009). CPLP certification. Retrieved November 23, 2013 from http://www.astd.org/Certification.

  • Arrindell, W. A., & Van der Ende, J. (1985). Cross-sample invariance of the structure of self-reported distress and difficulty in assertiveness. Advances in Behavior Research and Therapy, 7, 205–243.

    Article  Google Scholar 

  • Association for Educational Communications and Technology (AECT). (2012). AECT standards. Retrieved November 23, 2013 from http://c.ymcdn.com/sites/aect.site-ym.com/resource/resmgr/AECT_Documents/AECT_Standards_adopted7_16_2.pdf.

  • Brown, A., Sugar, B., & Daniels, L. (2007). Media production curriculum and competencies: Identifying entry-level multimedia production competencies and skills of instructional design and technology professionals: Results from a Biennial Survey. Paper presented at Association of Educational Communications and Technology, Anaheim, CA.

  • Coates, H., James, R., & Baldwin, G. (2005). A critical examination of the effects of learning management systems on university teaching and learning. Tertiary Education and Management, 11(1), 19–36.

    Article  Google Scholar 

  • Creswell, J. W. (2009). Research design: Qualitative, quantitative and mixed methods Approaches (3rd ed.). Los Angeles, CA: Sage.

    Google Scholar 

  • Daniels, L. (2008). Identifying entry-level competencies of instructional design and technology educators and professionals: Results from a biennial survey. In K. McFerrin et al. (Eds.), Proceedings of society for information technology & teacher education international conference 2008 (pp. 1381–1385). Chesapeake, VA: AACE.

  • Daniels, L., Sugar, W., Brown, A., & Hoard, B. (2012). Educational technology professionals in higher education: Multimedia production competencies identified from a Delphi study. In P. Resta (Ed.), Proceedings of society for information technology and teacher education international conference 2012, pp. 1711–1714.

  • Dessler, G. (2004). Human resource management (10th ed.). Upper Saddle River, NJ: Prentice Hall.

  • Earle, R. S., & Persichitte, K. A. (Eds.). (2005). Standards for the accreditation of school media specialist and educational technology specialist programs (4th ed.). Bloomington, IN: Association for Educational Communications and Technology.

    Google Scholar 

  • eLearning coach (2012). Starting an eLearning team. Retrieved November 23, 2013 from http://theelearningcoach.com/elearning_design/starting-an-elearning-department/.

  • Gaffney, C., Dagger, D., & Wade, V. (2008). Soft skill simulation authoring tools: A state of the art survey. Presented at WWW, Beijing.

  • Glaser, B. G., & Strauss, A. L. (1967). The discovery of grounded theory. Chicago, IL: Aldine.

    Google Scholar 

  • Green, K. (2010). 2010 campus computing survey. IT budget cuts slowing; campus LMS strategies in transition. Retrieved November 23, 2013 from http://www.campuscomputing.net/sites/www.campuscomputing.net/files/Green-CampusComputing2010.pdf.

  • Guadagnoli, E., & Velicer, W. F. (1988). Relation of sample size to the stability of component patterns. Psychological Bulletin, 103, 265–275.

    Article  Google Scholar 

  • Gustafson, K., & Branch, R. (1997). Survey of instructional design models. Syracuse, NY: Information Resource Publications.

    Google Scholar 

  • Hartley, R., Kinshuk, K. R., Okamoto, T., & Spector, J. M. (2010). The education and training of learning technologists: A competences approach. Educational Technology and Society, 13(2), 206–216.

    Google Scholar 

  • International Society for Performance Improvement (ISPI). (2013). International society for performance improvement—certified performance technologist. Retrieved November 23, 2013 from http://www.ispi.org/content.aspx?id=186&linkidentifier=id&itemid=186.

  • Januszewski, A., & Molenda, M. (2007). Educational technology: A definition with commentary. London: Routledge/Taylor and Francis Group.

    Google Scholar 

  • Kaiser, H. F. (1974). An index of factorial simplicity. Psychometrika, 39, 31–36.

    Article  Google Scholar 

  • Kenny, R. F., Zhang, Z., Schwier, R. A., & Campbell, K. (2005). A review of what instructional designers do: Questions answered and questions not asked. Canadian Journal of Learning and Technology, 31(1), 9–26.

    Google Scholar 

  • Kerlinger, F. (1974). Foundations of behavioural research. New York: Holt, Rienhart and Winston.

    Google Scholar 

  • Klein, J. D., & Richey, R. C. (2005). The case for international standards. Performance Improvement, 44(10), 9–14.

    Article  Google Scholar 

  • Lincoln, Y. S., & Guba, E. G. (1985). Naturalistic inquiry. Newbury Park, CA: Sage.

    Google Scholar 

  • Lowenthal, P., Wilson, B. G., & Dunlap, J. C. (2010). An analysis of what instructional designers need to know and be able to do to get a job. In Presented at the annual meeting of the Association for Educational Communications and Technology. Anaheim, CA.

  • Martin, F. & Winzeler, B. (2008). Multimedia Competencies for Instructional Technologists. In Proceeding of the UNC teaching and learning with technology conference. Raleigh, NC.

  • Mayer, R. E. (2001). Multimedia learning. New York: Cambridge University Press.

    Book  Google Scholar 

  • Merrill, D. (2007). The proper study of instructional design. In R. A. Reiser & J. V. Dempsey (Eds.), Trends and issues in instructional design and technology (2nd ed., pp. 336–341). Saddle River, NJ: Pearson Prentice Hall.

    Google Scholar 

  • Moallem, M. (1995). Analysis of job announcements and the required competencies for instructional technology professionals. ERIC document: ED405355.

  • Nunnally, J. (1978). Psychometric theory. New York: McGraw-Hill.

    Google Scholar 

  • Reigeluth, C. M. (1983). Instructional-design theories and models: An overview of their current status. Hillsdale, NJ: Erlbaum.

    Google Scholar 

  • Richey, R. C., Fields, D. C., Foxon, M. (with Roberts, R. C., Spannaus, T., & Spector, J. M.) (2001). Instructional design competencies: The standards (3rd ed.). Syracuse, NY: ERIC Clearinghouse on Information and Technology.

  • Ritzhaupt, A. D., Martin, F., & Daniels, K. (2010). Multimedia competencies for an educational technologist: A survey of professionals and job announcement analysis. Journal Educational Multimedia and Hypermedia, 19(4), 421–449.

    Google Scholar 

  • Russell, J., Russell, B., & Tastle, W. J. (2005). Teaching soft skills in a systems development capstone class. Information Systems Education Journal, 3(19), 3–19.

    Google Scholar 

  • Spector, J. M., Klein, J. D., Reiser, R. A., Sims, R. C., Grabowski, B. L., & Teja, I. D. L. (2006). Competencies and standards for instructional design and educational technology. Discussion paper for ITFORUM.

  • Sugar, W., Brown, A., & Daniels, L. (2009). Identifying entry-level multimedia production competencies and skills of instructional design and technology professionals: Results from the 2009–2010 biennial survey. In Presented at the annual conference of the Association for Educational Communications and Technology (AECT). Louisville, KY.

  • Sugar, W., Hoard, B., Brown, A., & Daniels, L. (2012). Identifying multimedia production competencies and skills of instructional design and technology professionals: An analysis of recent job postings. Journal of Educational Technology Systems, 40(3), 227–249.

    Article  Google Scholar 

  • Sumuer, E., Kursun, E., & Cagiltay, K. (2006). Current major competencies for instructional design and technology professionals. In E. Pearson & P. Bohman (Eds.), Proceedings of world conference on educational multimedia, hypermedia and telecommunications 2006 (pp. 1617–1622).

  • Tashakkori, A., & Teddlie, C. (1998). Mixed methodology: Combining qualitative and quantitative approaches. Thousand Oaks, CA: Sage.

    Google Scholar 

  • Tennyson, R. D. (2001). Defining core competencies of an instructional technologist. Computers in Human Behavior, 17, 355–361.

    Article  Google Scholar 

  • Van Rooij, S. W. (2010). Project management in instructional design: ADDIE is not enough. British Journal of Educational Technology, 41(5), 852–864.

    Article  Google Scholar 

  • Wakefield, J., Warren, S., & Mills, L. (2012). Traits, skills,andcompetencies aligned with workplace demands: What today’s instructional designers need to master. In P. Resta (Ed.), Proceedings of society for information technology and teacher education international conference 2012 (pp. 3126–3132).

  • Wang, N., Schnipke, D., & Witt, E. A. (2005). Use of knowledge, skill, and ability statements in developing licensure and certification examinations. Educational Measurement: Issues and Practice, 24(1), 15–22.

    Article  Google Scholar 

  • Wilson, M. (1974). Job analysis for human resource management: A review of selected research and development. ERIC Document: ED107860.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Albert D. Ritzhaupt.

Appendices

Appendices

Appendix 1

See Table 7.

Table 7 Knowledge domain

Appendix 2

See Table 8.

Table 8 Skills domain

Appendix 3

See Table 9.

Table 9 Ability domain

Rights and permissions

Reprints and permissions

About this article

Cite this article

Ritzhaupt, A.D., Martin, F. Development and validation of the educational technologist multimedia competency survey. Education Tech Research Dev 62, 13–33 (2014). https://doi.org/10.1007/s11423-013-9325-2

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11423-013-9325-2

Keywords

Navigation