Measureable Results
3-D ETC's training process, using 3D immersive video, WILL achieve measurable results!
3-D ETC collects and analyzes the measurable impact for every project. In some cases we custom develop evaluation tools so that we can measure the critical success factors that our clients are in need of. But, in most cases, the use of the Kirkpatrick Model which factors four key levels of impact helps us demonstrate not only tangible cost reduction results, but also statistically significant, positive shifts in perception, attitude and behavioral impact - something you might not be used to seeing from your standard training program!
Typical Results
Levels of Evaluation - Kirkpatrick Model
- Level One - Reaction
- Participant comments are often the best indication of a participant's reaction to training. Following are typical comments found on Exit surveys:
- “Great class. Great use of technology to drive important points.”
- “Instructor was very knowledgeable of subject, enjoy video and 3D technology, definitely changed my mindset in pacing attention on task as environment.”
- “The 3D experience helps you to be more aware of the video with the headsets on. You are not distracted with the surroundings around you. Example, the person next to you may be playing with their pen or pencil. With the headsets that eliminates that.”
- “Best safety video I've ever seen. Most are too corny. Very realistic.”
- “EXCELLENT!!! Best class in safety ever! In my years of safety training-This has been the best!!!”
- “Presentation was useful in helping to realize that small choices can make a difference and helping me refocus on safety on and off the job”
- “The method of presenting the information was new and creative. Made it easier to pay attention; wasn't the same redundant method.”
- “This by far was an excellent presentation. The presenter kept us focused and had excellent video materials. I was very much impacted by this training.”
- “We have never experienced a setting or Safety class like this one. Very Good!”
- “What can I say; Excellent!! We need this type of training every 6 months. In the long run we save money and lives!! Thanks”
- Level Two - Learning
This is the extent to which participants change attitudes, improve knowledge, and increase skills as a result of participating in the learning process. We compare the pre- to post-class survey results to obtain our Level 2 evaluations:
Measuring pre- to post- class data for key learning objectives provides two important pieces of information. First, seeing a positive increase in the pre- to post-class measurement (as above 2.6 to 4.7) show that participants have increased their awareness of the measurable. Second, a shift in variability provides an indication of getting participants “on the same page” in regard to the learning objective. Less the variability in the response shows that respondents are of similar opinion. Having less variability in the participant base generally indicates greater likelihood of successful change in the organization.
- Level Three - Performance (behavior)
We evaluate behavior change via surveys administered at key intervals post-training and compare those against the pre- and post-seminar data. The key indicator for change in behavior is sustained positive measurement (above base-line) of the exit (attitudinal) measurement. Below is a typical example of a 180-day follow up survey around one key learning objective:
Analysis of the three post-training data indicates no statistical significance between, suggesting a sustainment in the desired behavior.
- Level Four
- If behavior is truly impacted by a training intervention, the results should be measureable in your bottom line. In the sample below, the lost time accidents at this site, after the 3-D ETC training intervention, dropped considerably and stayed at those lower levels in subsequent years. It should be noted that at the initial intervention point, no other training had been instituted.
