More About Mistake-Proofing

After yesterday’s post about trucks crashing into the famous 11foot8 bridge and mistake proofing, I got the feeling I should drive home my key point that the problem isn’t with the driver, it is with the environment.

As of this writing,  Jürgen has recorded 154 crashes of overheight vehicles into the bridge.

And I’ll put even money that if all of the data were known, this process would pass any test for statistical control and we are getting what we should expect from a stable system. It might not be what we want, but it is what we should expect. (All images are copyright  Jürgen Henn, 11foot8.com)

So addressing the individual incidents probably isn’t a solution. In any case, it is unlikely that any driver will repeat the mistake.* For the TWI folks – this isn’t really a Job Relations type of problem. It might feel like it is, but it isn’t.

In the Factory

I was working with a company with a similar problem. Their inspectors kept missing defects. The response was often to say “I don’t see how she could have missed that!” and even write them up for failure to do something that wasn’t particularly well specified.

But the fact on the ground was, like the bridge, the misses weren’t confined to any particular individuals, any particular shift, any particular anything. People missed things all of the time because the expectations greatly exceeded the limitations of what humans can do for 12 hours (or even one hour). It isn’t an inspection problem. (The reliance on inspection vs. upstream controls is another topic for another day.)

People Work Within a System

It is all too easy to fall into the “bad apple” fallacy and seek out someone who was negligent. It feels good, like we did something about the problem. But the problem will happen again, with someone else. Then I hear frustrated managers start to make disparaging comments about their entire workforce that “doesn’t care” about quality.

I challenged a quality manager to do that inspection job for two hours – not even a complete shift – under the watchful eye of the inspector whose job he was trying to do. Funny – he was a lot slower to assign blame after that experience. He couldn’t keep up.

Deming was pretty clear about the ineffectiveness of exhortation as a way to get better performance. “Be more careful!” might well work for one individual for a short time. “Making an example of someone” might well work for a group for a short time. But there are norms, and the system will return to those norms very quickly. There are simple limits to what humans can focus on and for how long.

The Bridge is a Metaphor

To be clear, the bridge represents a working system, but it is different than what we would find in a company. This is public infrastructure, and the truck drivers that get featured on the videos are not part of a single organization.

This means that you have more control than the city engineers in Durham do. You can establish procedures, ask questions, train people, have them practice, alert them to the Gregson Street Bridge on their route. You can make sure your navigation system routes your trucks around the low bridges. You can support your people so they are less likely to even end up in the situation. All of these are system changes – and that is what it will take to change the outcome.

Change the System: Raising the Bridge

In late 2019 the city of Durham, in coordination with the railroad who owns the bridge, did actually raise the bridge by 8 inches. It is now 11 feet 16 inches (3.76m).

And that is a legitimate approach. Rather than trying to create infallible humans, what can we do to make the system less vulnerable to fallible humans.

While that likely reduced the number of trucks that hit the bridge…


*Caveat: There is one video where a truck seems to avoid the bridge, then circle back around and hit it. And another video where a truck that hit this bridge then proceeded to run into another low bridge with the damaged truck.

Mistake Proofing – Getting People’s Attention

Besides being a great source of schadenfreude, Jürgen Henn’s website, 11foot8.com offers some great insight in the difficulty of effective mistake-proofing.

Background

The clearance between the road and the railroad bridge at 201 Gregson Street in Durham, North Carolina is officially 11 feet 8 inches (3.55 meters).

A typical rental box truck is about 12 feet high (3.65 meters).

The result:

Penske rental truck smashed under low bridge.

The more astute of you may have noticed the “OVERHEIGHT MUST TURN” sign just above the smashed truck.

Well before the truck approaches the intersection, it passes under a height sensor. If the vehicle is overheight, the OVERHEIGHT MUST TURN sign comes on and starts to flash, and the traffic lights turn red.

While this effort did mitigate the problem, obviously there are drivers who simply do not notice. Lots of them. Jürgen has cameras trained on the intersection and captures over a dozen crashes in a typical year. As a result, his website has attracted international attention. See the short documentary here: http://11foot8.com/about/the-documentary/

Familiar Tasks = “In the Zone”

The human brain is an amazing thing. It also works by deceiving us. It creates the illusion of complete awareness of the things around us when, in reality, we are simply aware of a model our brains have constructed of what we perceive to be there.

It is also an amazing engine at engaging actions based on pattern matching. For example –

In sessions I facilitate, I routinely ask people if they can recall a time when they arrived home after work but realized they didn’t remember driving the route. Nearly every hand in the room goes up. That is pretty amazing because driving is an incredibly complex task. But, assuming you get a license in your mid-teens, by the time you are in your early 20s, most people don’t give it much thought. (There is a reason your insurance rates drop when you turn 25.)

It has become a hard-wired neural pattern, a series of habits, a programmed set of responses that are operating below below the conscious and deliberate thinking part of the brain. This is really good because this process is much faster and more responsive than the alternative. Think about how it felt to be driving when you were just learning – or how it feels to be doing anything new when you are just learning.

The downside to this amazing programming is that things that don’t jar us into consciousness often go unnoticed.

And the more familiar, the more expert, we are with the task at hand, the more likely this will happen.

Levels of Mistake Proofing

I like to talk about three levels of mistake-proofing. Four actually, if you count Zero as a level.

  • Level 0 – the task must be performed correctly from memory.
  • Level 1 – there is a discrete task of checking build into the job.
  • Level 2 – there is an active indication when a mistake is about to be made (or has just been made and there is still time to correct without consequences).
  • Level 3 – there is active prevention that gets in the way of making the mistake.

The OVERHEIGHT MUST TURN sign is a Level 2. The driver has already passed signs informing him of the bridge clearance about 100m before the bridge.

The height sensors are on the poles just past the speed limit signs.

Low clearance signs about 100m before the bridge. (Google Street View)

Then in the next block, there is another sign telling the driver to turn:

Approaching the last intersection (Google Street View)

And finally the light changes and the OVERHEIGHT MUST TURN sign illuminates.

And still they miss it.

(Direct YouTube link for the email readers: https://youtu.be/I0BJmC6u7MU)

To be clear, the vast majority of truck drivers don’t hit the bridge. But over a dozen a year do. (There were more before the flashing sign was put in.)

“Pay Attention!” = Fundamental Attribution Error

As we watch Jürgen’s videos it is easy to assign character attributes to the drivers who hit the bridge. If only they were better drivers. (The vast majority people who are asked to rate their driving skill will say they are “above average” by the way. Think about that.)

But it is human nature to get lulled into a bit of complacency when engaging a routine task- and driving is a routine task in spite of the complexity.

Now – think about the people in your organization. How many opportunities to they have to make a mistake every day… every hour… in the course of their work? How many of those possible mistakes have serious or expensive consequences?

They are experts at what they do. And they don’t make many mistakes. And they usually catch themselves before there is a problem. But the Law of Large Numbers says “Given enough opportunities, the unlikely is inevitable.”

Can anyone reading this honestly say they have never inadvertently run a stop sign? Yet accidents rarely occur. Now and then there is some panic braking, and rarely there is a collision.

Yet it is really easy to single out the person who:

Performs the work the same way, in the same conditions as everyone else.

Makes the same mistakes, just as often, as everyone else.

Just like everyone else, usually they are caught in time, or other conditions aren’t present for a bad outcome.

But this time everything lined up and BANG – the defective product got missed, or the leak wasn’t noticed before the sump went dry.

Then that person gets singled out for “not following procedure” when nobody follows procedure.

Job Instruction “Key Points” = Opportunity

In a Job Breakdown for TWI Job Instruction we assign a “Key Point” as something the learner must remember specifically because it:

  • Might result in a hazard – injure the worker or someone else.
  • “Make or break the job” – if something isn’t done a specific way, the task fails.
  • Is a “knack” or technique that makes it easier to do.

Those first two are red flags. You are asking your team member to memorize critical to safety and critical to quality tasks. My challenge: How many of those key points can you “mistake proof” out of the job breakdown?

Finally – rather than the sensors and flashing lit signs, there is this approach from “somewhere on the Internet.”

Warning Sign: If you hit this sign, you will hit that bridge.

That is awesome because even if the driver doesn’t see the sign, the BANG! may get his attention in time for it to register and stop. In the Durham, NC example above, apparently this wouldn’t work because there are legitimate reasons for trucks to come down the street up to the intersection just before the bridge. After that, it is really too late unless the driver is already aware that he has to turn.

Oh – and by the way – you can get souvenirs from the Gregson Street Bridge at  Jürgen’s store here:  https://squareup.com/store/11foot8-dot-com/ 🙂

There is a follow-up to this post here: https://theleanthinker.com/2020/05/28/more-about-mistake-proofing/

Meta-Patterns: Thoughts for Discussion

I’ll be sending out the Zoom meeting link this (Wednesday) afternoon (May 6, 2020) for the Thursday (11 am Pacific) open discussion on the Meta-Patterns of Innovation.

1901 Wright Glider
Wright Brothers’ Experiments with the 1901 Glider

For those who only got email on the original post, this is a direct link to the video I was referencing: https://videopress.com/v/geNgzN4e

There are still lots of spots for anyone who is interested. Click Here to open the Contact Page, and let me know your email address and I’ll add you to the list.

Hugh asked a really good question in his email that relates to how to put these concepts (that are somewhat abstract and philosophical) into practical application in an organization.

I think that is a really good starting off point for a discussion, especially among change agents.

KataCon4 Keynote: The Meta-Patterns of Innovation

Yes – the title isn’t a typo. This goes back to KataCon 4 in Atlanta. Though I had attended all of them, this was the first time I actually spoke at one. My task was to follow Rich Sheridan and share why I thought his message was a powerful one for an audience of Kata Geeks even if he wasn’t specifically talking about Toyota Kata in his company.

As an experiment, I took the sound recording from my talk and synchronized it with the slide deck. (That is harder that it sounds, by the way.) As another experiment I am sharing it via hosting on WordPress (the back-end of this site) rather than YouTube or a similar host. It is a little over 13 minutes long, and there is another experiment below it.