Abstract
Purpose
The goals of this investigation were to review current AC practices in the United States by evaluating whether they follow the Guidelines and Ethical Considerations for Assessment Center Operations (International Task Force on Assessment Centers, 2000). We both expanded upon and compared our results to a prior benchmarking study (Spychalski et al. in Personnel Psychol, 50:71–90, 1997), and investigated practices regarding job analysis, AC development, dimensions (i.e., job requirements), exercises, assessor characteristics and training, behavior recording, data integration, organizational policy, assessee rights, AC evaluation and AC technology. Data were collected via an online survey completed by individuals from human resource departments of organizations (N = 54) across the U.S; organizations to whom the survey was sent were selected by sampling Fortune 500 organizations based on economic sector.
Findings
Results indicate that 93% of organizations reported considering the Guidelines for AC development and use. More specifically, the investigation reports specific findings regarding job analysis, AC development, AC dimensions, AC exercises, assessor characteristics, assessor training, behavior recording, data integration, organizational policy, assessee rights, AC evaluation, and AC technology.
Implications
We provide two types of conclusions. First, based on two concerns, we provide two recommendations for improving current practice. Second, we present two commendations (i.e., positive trends that should continue). Finally, to continue to advance AC practice, we discuss our results in the context of observations on recent developments in AC practices by Lievens and Thornton (Assessment centers: Recent developments in practice and research. Blackwell, Malden, pp 243–264, 2005).
Originality/Value
Despite the importance of assessment centers (ACs) for personnel selection and development, no recent benchmarking studies exist.
Similar content being viewed by others
Notes
Even though Spychalski et al.’s (1997) investigation was published <20 years ago, data for their study were collected in 1990.
For current trends in development and selection of AC use, see Krause and Thornton III (2007).
Sub-category ‘similarity’ across both studies allowed for statistical comparison of compliance (i.e., chi-square tests). While the majority of our sub-criteria overlapped, some were collapsed to allow comparisons with Spychalski et al. (1997).
Multiple responses possible.
The questionnaire respondents received did not define data integration procedures (e.g., judgmental, statistical), as we were assuming that the respondents knew what each method entailed.
We thank an anonymous reviewer for this insightful comment.
We thank an anonymous reviewer for this idea.
References
Arthur, W. A., Jr., Day, E. A., McNelly, T. L., & Edens, P. S. (2003). A meta-analysis of the criterion-related validity of assessment center dimensions. Personnel Psychology, 56, 125–149.
Barrick, M. R., & Mount, M. K. (1991). The big five personality dimensions and job performance: A meta-analysis. Personnel Psychology, 44, 1–26.
Bowler, M. C., & Woehr, D. J. (2004). Assessment center construct-related validity: A big picture perspective. Poster presented at the annual conference of the Society for Industrial and Organizational Psychology, Chicago, IL.
Boyle, S., Fullerton, J., & Wood, R. (1995). Do assessment/development centres use optimum evaluation procedures? A survey of practice in UK organizations. International Journal of Selection and Assessment, 3, 132–140.
Brannick, M. T., & Levine, E. L. (2002). Job analysis: Methods, research, and applications for human resource management in the new millennium. Thousand Oaks, CA: Sage.
Bray, D. W., & Grant, D. L. (1966). The assessment center in the measurement of potential for business management. Psychological Monographs, 80, 1–27.
Briscoe, D. R. (1997). Assessment centers: Cross-cultural and cross-national issues. Journal of Social Behavior and Personality, 12, 261–270.
Caldwell, C., Thornton, G. C., III, & Gruys, M. L. (2003). Ten classic assessment center errors: Challenges to selection validity. Public Personnel Management, 32, 73–88.
Cascio, W. F. (2003). Changes in workers, work, and organizations. In W. C. Borman, D. R. Ilgen, & R. J. Klimoski (Eds.), Handbook of psychology: Volume 12 industrial and organizational psychology (pp. 401–422). Hoboken, NJ: Wiley.
Chan, D. (1996). Criterion and construct validation of an assessment center. Journal of Occupational and Organizational Psychology, 69, 167–181.
Colquitt, J. A., Conlon, D. E., Wesson, M. J., Porter, C. O. L. H., & Ng, K. Y. (2001). Justice at the millennium: A meta-analytic review of 25 years of justice research. Journal of Applied Psychology, 86, 425–445.
Daft, R. L., & Lengel, R. H. (1986). Organizational information requirements, media richness and structural design. Management Science, 32, 554–571.
Development Dimensions International. (2006). DDI opens newest executive assessment center in NYC. Retrieved August 5, 2006, from http://www.ddiworld.com/about/pr_releases.asp?id=81.
Development Dimensions International. (2009). Validity of DDI assessment centers. Retrieved August 5, 2006, from http://www.ddiworld.com/pdf/ddi_thevalidityofddiassessmentcenters_wp.pdf.
Díaz-Canepa, C. (2005). Transferring technologies to developing countries: A cognitive and cultural approach. In R. J. Sternberg & R. J. Preiss (Eds.), Intelligence and technology: The impact of tools on the nature and development of human abilities (pp. 159–180). Mahwah, NJ: Lawrence Erlbaum.
Feltham, R. (1988). Assessment centre decision making: Judgmental vs. mechanical. Journal of Occupational Psychology, 61, 237–241.
Fitzgerald, L. F., & Quaintance, M. K. (1982). Survey of assessment center use in state and local government. Journal of Assessment Center Technology, 5, 9–21.
Fletcher, C. (1994). Questionnaire surveys of organizational assessment practices: A critique of their methodology and validity, and a query about their future relevance. International Journal of Selection and Assessment, 2, 172–175.
Gaugler, B. B., Rosenthal, D. B., Thornton, G. C., III, & Bentson, C. (1987). Meta-analysis of assessment center validity. Journal of Applied Psychology, 72, 493–511.
Gaugler, B. B., & Thornton, G. C., III (1989). Number of assessment center dimensions as a determinant of assessor accuracy. Journal of Applied Psychology, 74, 611–618.
Gephart, R. P. (2002). Introduction to the brave new workplace: Organizational behavior in the electronic age. Journal of Organizational Behavior, 23, 327–344.
Greenberg, J. (1993). The social side of justice: Informational and interpersonal classes of organizational justice. In R. Cropanzano (Ed.), Justice in the workplace: Approaching fairness in human resource management (pp. 79–103). Hillsdale, NJ: Erlbaum.
Griffiths, P., & Goodge, P. (1994). Developmental centers: The third generation. Personnel Management, 25, 307–319.
Hausknecht, J. P., Day, D. V., & Thomas, S. C. (2004). Applicant reactions to selection procedures: An updated model and meta-analysis. Personality Psychology, 57, 639–683.
Hennessy, J., Mabey, B., & Warr, P. (1998). Assessment center observation procedures: An experimental comparison of traditional, checklist and coding methods. International Journal of Selection and Assessment, 6, 222–230.
Hogan, R., Hogan, J., & Roberts, B. (1996). Personality measurement and employment decisions. American Psychologist, 51, 469–477.
Hollenbeck, G. P. (1990). The past, present, and future of assessment centers. The Industrial/Organizational Psychologist, 28(2), 13–17.
Howard, A. (1997). A reassessment of assessment centers: Challenges for the 21st century. Journal of Social Behavior and Personality, 12, 13–52.
Hunter, J. E., & Hunter, R. F. (1984). Validity and utility of alternative predictors of job performance. Psychological Bulletin, 96, 72–98.
International Task Force on Assessment Center Guidelines. (2000). Guidelines and ethical considerations for assessment center operations. Public Personnel Management, 29, 315–332.
Joiner, D. (2002). Assessment centers: What’s new? Public Personnel Management, 31, 179–185.
Joiner, D. A. (2004). Assessment center trends: Assessment center issues and resulting trends. Paper presented at the 28th annual meeting of IPMAAC, Seattle, Washington.
Krause, D. E., & Gebert, D. (2003). A comparison of assessment center practices in organizations in German-speaking regions and the United States. International Journal of Selection and Assessment, 11, 297–312.
Krause, D. E., Gebert, D., & Thornton, G. C., III (2007). Interkulturelle Unterschiede in der Assessment Center Anwendung [Cross-cultural differences in the use of assessment centers]. In H. Schuler (Ed.), Assessment Center zur Potenzialanalyse (pp. 359–378). Göttingen: Hogrefe.
Krause, D. E., Kersting, M., Heggestad, E. D., & Thornton, G. C. (2006). Criterion validity of assessment centers and cognitive ability tests. An empirical study on the executive management level. International Journal of Selection and Assessment, 14(4), 360–371.
Krause, D. E., & Thornton III, G. C. (2004). Cultural values and assessment center practices in the Americas, Europe, and Asian Countries. Presentation at the 32nd International Congress on Assessment Center Methods, Las Vegas, NV.
Krause, D. E., & Thornton III, G. C. (2007). The design, execution, and evaluation of selection versus development assessment centers—A study in north and central America, Asia, and Europe. Symposium paper presented at the 22nd annual conference for the Society of Industrial and Organizational Psychology, New York, NY.
Kudisch, J. D., Avis, J. M., Fallon, J. D., Thibodeaux III, H. F., Roberts, F. E., Rollier, T. J., & Rotolo, C. T. (1999). Benchmarking for success: A look at today’s assessment center practices worldwide. Paper presented at the 27th annual meeting of the International Congress on Assessment Center Methods, Orlando, FL.
Lance, C. E., Lambert, T. A., Gewin, A. G., Lievens, F., & Conway, J. M. (2004). Revised estimates of dimension and exercise variance components in assessment center post exercise dimension ratings. Journal of Applied Psychology, 89, 377–385.
Landy, F. J. (2005). Employment discrimination litigation: Behavioral, quantitative, and legal perspectives. San Francisco: Jossey-Bass.
Lievens, F. (1999). Development of a simulated assessment center. European Journal of Psychological Assessment, 15, 117–126.
Lievens, F., & Conway, J. M. (2001). Dimension and exercise variance in assessment center scores: A large-scale evaluation of multitrait–multimethod studies. Journal of Applied Psychology, 86, 1202–1222.
Lievens, F., Harris, M. M., Van Keer, E., & Bisqueret, C. (2003). Predicting cross-cultural training performance: The validity of personality, cognitive ability, and dimensions measured by an assessment center and a behavioral description interview. Journal of Applied Psychology, 88, 476–489.
Lievens, F., & Thornton, G. C., III (2005). Assessment centers: Recent developments in practice and research. In A. Evers, N. Anderson, & O. Voskuijl (Eds.), The Blackwell handbook of personnel selection (pp. 243–264). Malden, MA: Blackwell.
Lind, E. A., & Tyler, T. R. (1988). The social psychology of procedural justice. New York: Plenum.
London, M. (2003). Job feedback: Giving, seeking, and using feedback for performance improvement. Mahwah, NJ: Lawrence Erlbaum.
Lovler, R., & Goldsmith, R. F. (2002). Cutting edge developments in assessment center technology. Paper presented at the 30th International Congress on Assessment Center Methods, Pittsburgh, PA.
Lowry, P. E. (1996). A survey of assessment center process in the public sector. Public Personnel Management, 25, 307–322.
Meehl, P. E. (1954). Clinical versus statistical prediction: A theoretical analysis and a review of the evidence. Minneapolis, MN: University of Minnesota.
Meyer, J. P., Stanley, D. J., Herscovich, L., & Topolnytsky, L. (2002). Affective, continuance, and normative commitment to the organization: A meta-analysis of antecedents, correlates and consequences. Journal of Vocational Behavior, 61, 20–52.
Page, B. T. (1995). Assessment center handbook. Longwood, FL: Gould.
Reilly, R. R., Henry, S., & Smither, J. W. (1990). An examination of the effects of using behavior checklists on the construct validity of assessment center dimensions. Personnel Psychology, 43, 71–84.
Rupp, D. E., Gibbons, A. M., Baldwin, A. M., Snyder, L. A., Spain, S. M., Woo, S. E., Brummel, B., Sims, C., & Kim, M.-J. (2006). An initial validation of developmental assessment centers as accurate assessments and effective training interventions. Psychologist-Manager Journal, 9, 171–200.
Ryan, A. M., McFarland, L., Baron, H., & Page, R. (1999). An international look at selection practices: Nation and culture as explanations for variability in practice. Personnel Psychology, 52(2), 359–391.
Salgado, J. F., Viswesvaran, C., & Ones, D. S. (2001). Predictors used for personnel selection: An overview of constructs, methods, and techniques. In N. Anderson, D. S. Ones, H. K. Sinangil, & C. Viswesvaran (Eds.). Industrial, Work & Organizational Psychology (Vol. 1, pp. 165–199). Thousand Oaks, CA: Sage.
Shippmann, J. S., Ash, R. A., Battista, M. A., Carr, L., Eyde, L. D., Hesketh, B., et al. (2000). The practice of competency modeling. Personnel Psychology, 53, 703–740.
Society for Industrial and Organizational Psychology, Inc. (2003). Principles for the validation and use of personnel selection procedures (4th ed.). College Park, MD: American Psychological Association.
Spychalski, A. C., Quinones, M. A., Gaugler, B. B., & Pohley, K. (1997). A survey of assessment center practices in organizations in the United States. Personnel Psychology, 50, 71–90.
Tett, R. P., & Burnett, D. D. (2003). A personality trait-based interactionist model of job performance. Journal of Applied Psychology, 88, 500–517.
Thibaut, J., & Walker, L. (1975). Procedural justice: A psychological analysis. Hillsdale, NJ: Lawrence Erlbaum.
Thornton, G. C., III (1992). Assessment centers in human resource management. Reading, MA: Addison-Wesley.
Thornton, G. C., III, & Byham, W. C. (1982). Assessment centers and managerial performance. New York: Academic Press.
Thornton, G. C., III, & Mueller-Hanson, R. (2004). Developing organizational simulations: A guide for practitioners and students. Mahwah, NJ: Lawrence Erlbaum.
Thornton, G. C., III, Murphy, K. R., Everest, T. M., & Hoffman, C. C. (2000). Higher cost, lower validity and higher utility: Comparing the utilities of two tests that differ in validity, costs, and selectivity. International Journal of Selection and Assessment, 8, 61–75.
Thornton, G. C., III, & Rupp, D. E. (2005). Assessment centers in human resource management: Strategies for prediction, diagnosis, and development. Mahwah, NJ: Lawrence Erlbaum.
Tillema, H. H. (1998). Assessment of potential, from assessment centres to development centres. International Journal of Selection and Assessment, 6, 185–191.
Trevino, L. K., Daft, R. L., & Lengel, R. H. (1990). Understanding managers’ media choices: A symbolic interactionist perspective. In J. Fulk & C. Steinfield (Eds.), Organizations and communications technology (pp. 71–94). Newbury Park, CA: Sage.
Trompenaars, A. (1993). Riding the waves of culture: Understanding diversity in global business. New York: Irwin.
Tziner, A., & Dolan, S. (1982). Validity of an assessment center for identifying future female officers in the military. Journal of Applied Psychology, 67, 728–736.
Acknowledgments
We thank two anonymous reviewers for their comments. We also thank the DAAD (German Academic Exchange Institution) for their financial support during Diana’s visiting research stay at Colorado State University.
Author information
Authors and Affiliations
Corresponding author
Additional information
Received and reviewed by former editor, George Neuman.
Rights and permissions
About this article
Cite this article
Eurich, T.L., Krause, D.E., Cigularov, K. et al. Assessment Centers: Current Practices in the United States. J Bus Psychol 24, 387–407 (2009). https://doi.org/10.1007/s10869-009-9123-3
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10869-009-9123-3