Donald L. Kirkpatrick (March 15, 1924 – May 9, 2014) was Professor Emeritus at the University of Wisconsin in the United States and a past president of the American Society for Training and Development (ASTD). He is best known for creating a highly influential 'four level' model for training course evaluation, which served as the subject of his Ph.D. dissertation in 1954. Kirkpatrick's ideas were published to a broader audience in 1959 in a series of articles in the US Training and Development Journal, but they are better known from a book he published in 1994 entitled Evaluating Training Programs. Other books that he has written on training evaluation include Transferring Learning to Behavior and Implementing the Four Levels. His work is carried on by his eldest son, Dr. Jim Kirkpatrick, and Wendy Kayser Kirkpatrick, and Vanessa Alzate.
Four Levels of Learning Evaluation
editKirkpatrick's four levels are designed as a sequence of ways to evaluate training programs. Many practitioners believe that as you proceed through each of the levels, the evaluation becomes more difficult and requires more time. Clomedia.com Editor suggests "it is best to look at the levels as a categorization scheme (i.e., their original purpose) in order to guide your staff in what levels to apply to the evaluation task".[1] In practice, then, it is common for trainers to get stuck in Levels 1 and 2 and never proceed to Levels 3 and 4, where the most useful data exist. Today, Kirkpatrick-certified facilitators stress "starting with the end in mind," essentially beginning with Level 4 and moving backward in order to better establish the desired outcome before ever planning the training program.[2] When done strategically, reaching these levels does not have to be any more expensive or time consuming, but will still help to ensure on-the-job performance of learned behaviors and skills.
The four levels of Kirkpatrick's evaluation model are as follows:
- Reaction - The degree to which participants find the training favorable, engaging and relevant to their jobs
- Learning - The degree to which participants acquire the intended knowledge, skills, attitude, confidence and commitment based on their participation in the training
- Behavior - The degree to which participants apply what they learned during training when they are back on the job
- Results - The degree to which targeted outcomes occur as a result of the training and the support and accountability package
Several authors have suggested an addition of a fifth level of evaluation. JJ Phillips has argued for the addition of a Return on Investment (ROI) level, which is essentially about comparing the fourth level of the standard model to the overall costs of training.[3] Roger Kaufman has argued that ROI is essentially a Level 4 type of evaluation because it is still internal to the organization and that a fifth level of evaluation should focus on the impact of the organization on external clients and society.[4][5][6]
Bibliography
edit- Kirkpatrick, Donald L., & Kirkpatrick, J. (1994). Evaluating Training Programs, Berrett-Koehler Publishers
- Kirkpatrick, Donald L., & Kirkpatrick, J. (2005). Transferring Learning to Behavior, Berrett-Koehler Publishers
- Kirkpatrick, Donald L., & Kirkpatrick, J. (2007). Implementing the Four Levels, Berrett-Koehler Publishers
References
edit- ^ Evaluation as a Strategic Tool Clomedia.com Editor - 5/17/04
- ^ Ed Forest: Kirkpatrick Model: Four Levels of Learning Evaluation, Educational Technology
- ^ Phillips, J. (1996). How much is the training worth? Training and Development, 50(4),20-24.
- ^ Watkins, R., Leigh, D., Foshay, R. and Kaufman, R. (1998). Kirkpatrick Plus: Evaluation and Continuous Improvement with a Community Focus. Educational Technology Research & Development, 46(4): 90-96.
- ^ Kaufman, R. (1996). Strategic Thinking: A Guide to Identifying and Solving Problems. Arlington, VA. & Washington, D.C. Jointly published by the American Society for Training & Development and the International Society for Performance Improvement.
- ^ Kaufman, R. (2000).Mega Planning: Practical Tools for Organizational Success. Thousand Oaks, CA. Sage Publications. (Also Planificación Mega: Herramientas practicas paral el exito organizacional. (2004). Traducción de Sonia Agut. Universitat Jaume I, Castelló de la Plana, Espana.)
External links
edit- Don Kirkpatrick: The Father of the Four Levels - (Biographical article from Chief Learning Officer Magazine, November 2009): "[1] Archived 2017-10-26 at the Wayback Machine"
- Report of Dr. Kirkpatrick's passing away: "https://web.archive.org/web/20140627121849/http://www.workforce.com/articles/20467-four-levels-of-measurement-creator-don-kirkpatrick-dies"
- Kirkpatrick website: "https://www.kirkpatrickpartners.com/the-kirkpatrick-model/"