Vocations · Job Skills

Did the training change
the work?

Training surveys ask whether people liked the session. Only a supervisor can see whether they use it a month later, and whether the job lets them. Observe each employee after a training, rate how well they apply it, compare a work measure before and after and check four conditions for using it. The form flags results read too soon and low use explained by missing tools or time.

Record an observationWhat you get
$12one-time · every device you sign in on
Buy · $12

Included with Caveat Classroom and Whole-school licenses. Or get it in the Job search kit, $29 for 41 items.

Observations

The worked example is made up: a forklift refresher that cut near misses, a de-escalation training checked after only nine days and a spreadsheet course with no software to practice on. Saved on this device only, by employee code.

Loading the observation form. If nothing appears, turn on JavaScript.

What you get

Vocations · Job Skills$12 · included with Classroom and Whole-school licenses

What you finish with
A record per observation: employee code, training, end and observation dates, a 1 to 5 rating of use on the job, a work measure before and after with its direction, four transfer conditions and comments. Works out days between training and observation and the change in the measure (positive is better); lists results by training; flags observations under 30 days, low use with missing conditions and measures moving the wrong way.
Who it is for
Supervisors, team leads and training coordinators in workplaces and workforce partnerships.
Format
Browser form with a saved record per observation. Prints one observation, every observation in a table or a blank form; downloads a spreadsheet (.csv); exports and imports a file.
Access
$12 one-time, yours on every device you sign in on; the tool opens once you are signed in with it. Included with Caveat Classroom and Whole-school licenses. Also in the Job search kit ($29) and the Vocations Suite pass ($99), and 1 more bundle. Everything you type stays in this browser; nothing is sent to Caveat.
Where it lives
The Job Skills space in Caveat Vocations.
Support
Questions about access, an order or a correction: team@caveatacademic.com.

How to use it

  1. Pick a measure before the training starts.
  2. Wait a month or more to observe.
  3. Watch the work, then rate it.
  4. Check the four conditions honestly.
  5. Fix conditions before judging the training.

Record an observation

Four levels of evaluation

Four levels of training evaluationLevelAsksWho can see it1 · ReactionDid they find it useful?Trainee survey2 · LearningDid they learn it?Test or demonstration3 · BehaviorDo they use it at work?The supervisor, on the job4 · ResultsDid the work measure change?Records over timeFour levels of training evaluation1 · ReactionAsks: Did they find it useful?Who can see it: Trainee survey2 · LearningAsks: Did they learn it?Who can see it: Test or demonstration3 · BehaviorAsks: Do they use it at work?Who can see it: The supervisor, on the job4 · ResultsAsks: Did the work measure change?Who can see it: Records over time
This form covers levels 3 and 4, the ones only a supervisor can see. A good training can still fail at level 3 when the job does not let people use it.

Why wait

New skills take practice before they show up in daily work, and the first weeks after a training are often busier than usual. Observing after a month or more gives a fairer picture of whether the training took.

Conditions decide

Research on training transfer finds that what happens after the session, time to practice, the right tools and a supervisor who asks about it, matters as much as the training itself.

Sources

  1. Kirkpatrick, J. D. and Kirkpatrick, W. K. (2016). Kirkpatrick’s Four Levels of Training Evaluation. ATD Press.
  2. Blume, B. D., Ford, J. K., Baldwin, T. T. and Huang, J. L. (2010). Transfer of training: a meta-analytic review. Journal of Management, 36(4).
  3. Grossman, R. and Salas, E. (2011). The transfer of training: what really matters. International Journal of Training and Development, 15(2).
  4. U.S. Department of Labor, Employment and Training Administration. Incumbent worker and customized training evaluation resources (dol.gov).

The worked example is made up. Nothing you type is sent to Caveat. Support: team@caveatacademic.com.