BIC - May 2017
By: Shawn M. Galloway
Printable Version
How much value are you obtaining from your safety communication and training efforts? In the 1950s, a simple model was created to measure training effectiveness. How quickly we forget. Dr. Donald L. Kirkpatrick, when looking at opportunities to determine the effectiveness of training efforts, identified four levels to evaluate. The first level focuses on how the people receiving the training reacted to the information or experience (Reaction). The second level has to do with evaluating the change in knowledge, skill set and attitude (Learning). The third level looks at a change or continuance of observable behavior within the work setting (Behavior). Finally, he looked at the measurable benefits the organization realized following the training (Results).
Too many businesses tend to look only at the amount of effort put into safety communication and training and then the results yielded. They falsely believe when results improve, it is due to the effort applied. This is the correlation-causation trap.
In several recent consulting engagements, we at ProAct Safety have focused clients on better understanding the Return on Safety Attention (R.O.S.A.) and Safety Intelligence Quotient (Safety I.Q.) resulting from their efforts.
R.O.S.A. — Return on Attention is a common measurement among marketing professionals and can easily be applied to safety. If you have a thirty-minute safety meeting or training session and four important topics are discussed, how much information sticks with people? If, thirty days following the event, you poll the attendees and most only remember half of what was discussed, you have a 50% R.O.S.A. leveraging Kirkpatrick's model, a level-two R.O.S.A. metric.
Level-three thinking measures changes in behavior as a result of the meeting. If a call to action to nudge an increase in discretionary safety efforts was the focus, did it change behavior in the workforce? Behavior is observable, and thus measureable. R.O.S.A. for behavior could also be a metric and a more effective indicator of the value derived from the effort.
Safety I.Q. — In 1951, the National Safety Council released a fifteen minute, black-and-white video (to note the marketing language, it highlighted being available with sound!) with the goal of increasing the public's knowledge of accident prevention strategies in home, traffic and recreational sports. It was titled, "What is Your Safety I.Q.?" What a valuable question. Do your employees and leaders know the most important things about your safety efforts, program or system?
If your safety management system has six elements, with a quiz covering the most important aspects individuals should know with five questions each, the highest Safety I.Q. for someone who answered everything correctly would be 30. Moreover, if you have a high average Safety I.Q., what is the behavioral R.O.S.A. from this knowledge?
Most organization never achieve the results they pursue because they spend most of their time measuring and focusing attention on what they don't want rather than on what they do. We want people to appreciate our safety communication and training. We certainly want people to know and do certain things so when we obtain improvement in performance and cultural results, we know why. We will all be held accountable for the results yielded from our efforts. Clients with measurements on R.O.S.A and Safety I.Q. are much more focused on efficiency and value-addition. When this occurs, not only do the results improve, but so does the appreciation of those involved or affected by the training and communication.
Shawn M. Galloway is the CEO of ProAct Safety and an advisor to leading organizations across all major industries. With over twenty years of experience in safety systems, strategy, culture, leadership, and employee engagement, he is a trusted advisor, keynote speaker, and expert witness.
He is the author of several bestselling books and has multiple regular columns in leading magazines, with over 400 articles and 100 videos to his credit. He also created the first safety podcast, Safety Culture Excellence, with over 800 episodes. Shawn has received numerous prestigious accolades and has been featured in Power 101 Leaders of the EHS World, Top 50 People Who Most Influenced EHS, Top 40 Rising Stars, Top 11 Health and Safety Influencers, and Top 10 Speakers.
He serves on the Harvard Business Review Advisory Council and the Fast Company Executive Board. He has appeared as a guest on Bloomberg, Fox News, The Daily Mail, Dubai One, U.S. News & World Report, Sirius Business Radio, Wharton Business Daily, and leading safety magazines and podcasts, reinforcing his status as an authority in the field of safety excellence.
For more information, call +1.936.273.8700 or email info@ProActSafety.com.