How Do You Measure Toyota Kata?

I’ve run into a couple of cases where there is an initiative from a corporate continuous improvement team to “implement Toyota Kata.”

Aside from trying to proscribe each and every step of the way (which runs counter to the entire point of discovering the solution – “you omitted step 7b”), they also expect reports of metrics related to the “implementation.”

Things like:

  • Number of coaches.
  • Number of coaching sessions.
  • Number of active improvement boards.
  • Scoring learners on a dozen or so categories of specific attributes for their coaching session.

Then there are bureaucratic reporting structures demanding that this information (and much, much more) get dutifully filled in and reported up to the continuous improvement office so they could monitor how each site is progressing (often from across an ocean).

I’ve seen this before.

I’ve seen companies try to count kaizen events, and quantify the improvements for each one to justify the payback of the effort.

Similarly, I’ve seen top-level corporate leadership teams struggle to determine how to measure, at a glance, whether a site was “doing lean” to get their results (or getting the results by some other means(?) that were less appropriate).

I’ve seen companies try to manage quality by having the quality staff prepare and submit elaborate monthly reports about what was, and was not getting done based on what they felt was important.

I lump all of this under “management by measurement.” I think it is often a substitute for (1) trusting middle management to tell the truth and (2) actually talking to people.

What’s The Alternative?

First we need to work out what we really want people, especially middle managers, to actually do. What would full participation look like if you saw it?

For example, one company I work with has had a problem where middle managers send their people to internally run “kata training,” then say they have no time to coach their people, give them ambiguous or shallow challenges to work on, and generally look at the training as someone else’s responsibility.

OK, what do you want them to do?

In their book Switch, Chip and Dan Heath talk about “scripting the first moves” so someone who is unsure how to begin doesn’t need to expend limited psychological energy figuring out how to start. We want to get them going. We don’t need to lay out the entire process (that will end up being different for everyone) but we can create some clear rules or guidelines for getting started.

From the Switch Workbook on the Heath Brother’s web site:

Be clear about how how people should act.

This is one of the hardest – and most important – parts of the framework. As a leader, you’re going to be tempted to tell your people things like: “Be more innovative!” “Treat the customer with white-glove service!” “Give better feedback to your people!” But you can’t stop there. Remember the child abuse study [from the book]? Do you think those parents would have changed if the therapists had said, “Be more loving parents!”  Of course not. Look for the behaviors.

Asking that question, in terms of what they would actually see their middle managers doing, we came up with three general actions:

  • Work with their learner / improver to establish a clear challenge for them.
  • Commit to regular coaching cycles with their improver.
  • Commit to receiving 2nd level coaching during those sessions (so they can learn as well).

The question then becomes what mechanism can the organization put into place to encourage that behavior vs. just sending people to the class and not following up in any way.

It is easy to tell people what they shouldn’t do. It’s a little tougher to tell them what they should do.

In this case, we discussed establishing prerequisites for sending someone to the class. But these prerequisites are for the organization sending the participant to the training, rather than just the person attending the class.

It is the sponsoring manager who must commit (perhaps even in writing) to ensuring there is an improvement challenge; to establishing a regular coaching cycle; and to welcoming 2nd level coaching.

Perhaps this would be a commitment to the advance team who becomes a bit of an admissions committee – ensuring the support structure is there before we commit to taking someone on in the class.

We discussed taking a copy of the organization chart and putting dots on it where they had active improvement boards and coaching relationships. That would highlight which organization groups were developing their own people and which ones were doing less of it.

We discussed inviting the middle managers who have sent people to the class but, today, are not supporting, to come to the advanced team with a plan – perhaps a similar commitment – for their renewed participation. But no one would be required, because you can’t force anyone to learn something. Put your energy toward the people who want to learn. Trying to get participation from people who don’t want to do it just frustrates everyone.

And finally, create a mechanism for someone inside a non-participating organization to raise their hand and ask for help with their own development. Don’t punish the entire organization because their boss won’t play.

Now you are talking about mechanics, about actions that have testable outcomes: Experiments that can be set up and tried, improved, and iterated in the direction of something that works for your organization.

It is more work than just measuring people. And it doesn’t work every time. But it works more often than something that never works.

Output vs. Takt Time

The team’s challenge is to reach steady output of 180 units per hour.

Their starting condition was about 150 per hour. Their equipment and process is theoretically capable of making the 180 per hour with no problem.

They calculated their takt time (20 seconds) and established a planned cycle time of 17 seconds.

Some time later, they are stuck. Their output has improved to the high 160s, but those last 10-12 units per hour are proving elusive.

This is the point when I saw their coaching cycle.

Looking at their history, they had set a series of target conditions based on output per hour. Their experiments and countermeasures had been focused on reducing stoppages, usually on the order of several minutes.

“Does anybody have a calculator?”

“Divide 3600 seconds by 180, what do you get?”

“20 seconds.”

“Do you agree that if your line could reliably produce one module every 20 seconds that you would have no trouble reaching 180 modules per hour?”

Yes, they agreed.

“So what is stopping you from doing that?”

They showed me the average cycle times for each piece step in the process, and most were at or under 15 seconds. But averages only tell a small part of the story. They don’t show the cumulative effect of short stoppages and delays that can cascade through the entire line.

The team had done a lot of very good work eliminating the longer delays. But now their target condition had to shift to stability around their planned cycle time.

Performance vs Process Metrics

This little exercise shows the difference between a process metric and the performance metric.

Units-per-hour is a performance metric. It is measured after the fact, and tells the cumulative effect of everything going on in the process. In this case, they were able to make a lot of progress just looking at major stoppages..

Stability around the planned cycle time or takt time (you may use different words, that’s OK) is a process metric.

It shows you what is happening right now. THIS unit was just held up for 7 seconds. The next three were OK, then a 10 second delay. It’s those small issues that add up to missing the targeted output.

The team’s next target condition is now to stabilize around their planned cycle time.

Since they averaged their measurements, their next step is to (1) take the base data they used to calculate the averages and pull the individual points back out into a run chart and (2) to get out their stopwatches and go down and actually observe and time what is really going on.

I expect that information to help them clarify their target condition, pick off a source of intermittent delay, and start closing the remaining gap.

The Myth of 10,000 Hours

In this TEDx talk, Josh Kaufman, author of The First 20 Hours outlines his theory of learning a new skill.

One of his key points is the prevailing belief that you must spend 10,000 hours practicing a skill to become good at it.

This equates to over 5 years of practice 8 hours a day, 5 days a week.

Intuitively, we all know we have developed competency at tasks in far less time.

The 10,000 hours is practice to become able to perform at an elite, world-class level against intense competition. A top grand master at chess. A winning starting NFL quarterback. To get on the top podium at the Olympic Games.

But as Kaufman points out, the first part of the learning curve – up to basic competency or even above, is very steep. The thousands of hours are for developing on a far more shallow slope into the level of the elites.

In the video, Kaufman broke the basic learning process down to four steps which mirror the structure behind Toyota Kata.

Deconstruct the Skill.

We, in the lean community, made a huge mistake in attempting to deconstruct “continuous improvement.” Instead of deconstructing the process of continuous improvement, we instead deconstructed the production processes that resulted.

We ended up with a list of production process characteristics – “you have to have kanban,” and “you have to have standard work” rather than breaking down the skills that were applied to achieve them.

Toyota Kata gives us a deconstruction of the basics of continuous improvement so that we can learn them. That doesn’t mean there aren’t advanced nuances to learn, but those are built on the foundation of competence with the basics.

And basic competence can get you a long way.

Just to be clear, this doesn’t mean you can get away without understanding the basic tools. It’s just that, in so many cases, they have been put into place without that understanding. The tools are there to help define “what should be happening” and clarify “what is actually happening” so you can apply the correct thought process and use them to drive improvement. Without the underlying thought process, taught by the improvement kata, sustaining the “tools implementation” is very difficult.

Learn enough to self-correct.

Learning enough to self-correct means that you can recognize the difference between what how you are doing it, and how you want to be doing it.

(There’s that “should be happening” and “is actually happening” theme again.)

You can certainly teach yourself to play the piano, or even teach yourself multivariate calculus.There were no flight instructors for Wilbur and Orville Wright, yet they managed to develop very sophisticated skill with aircraft that were dangerously unstable by any modern standard.

But to learn effectively, you need some baseline of what “doing it right” looks like. Sometimes that is obvious. Sometimes it is more subtle.

This is where having a coach really helps. A coach stops you before you get into trouble. He can correct a nuanced imperfection in your technique that may have a major impact. Having a coach can get you to this point much faster.

That’s why many people hire a coach, sometimes by a different name like “taking lessons” or “going to school” to help them get through this phase more quickly.

Most of the good Toyota Kata classroom training out there gets you close to, but usually not quite over, this point. You can try it, you can get through a PDCA cycle with good coaching, but likely you can’t pick up enough to self-correct yet. THAT requires practice with a coach until you catch on to what “good” looks like.

Remove barriers to practice.

If you are coaching or teaching, this is far as you can get someone to go if they really don’t want to participate.The learner has to want to learn the skill, because everything past this point requires internal motivation.

Feeling stupid is a barrier to sitting down and doing the work. The opposite way to say the same thing is “needing to look like you know what you are doing before you know how to do it.”

This is one reason there has to be self-motivation – because you have to be willing to be incompetent in order to build competence.

For some reason corporate training, and related adult education programs, call it “good” if you have your backside in the seat for the required number of hours. Does it matter if you were on your email the whole time? Often no.

So people get sent to the Corporate Training Department’s “Problem Solving” course, get it on their transcript, and are expected to be able to do it. Same thing for “Handling Problem Employees,” “Lock-out / Tag-out” and a myriad of other corporate topics. The goal is almost to simply create a record that you attended, so they can say “We trained him” and remove legal responsibility.

Toyota Kata doesn’t work that way. Many managers struggle with the idea that they have to do more than just attend the class. They are their own barriers to practice.

What are yours?

Practice at least 20 hours.

This isn’t the “myth of needing to practice.” You actually need to do the work.

20 hours of practicing the improvement kata breaks down to roughly 40 days if you are thinking that way on purpose and reflecting on your actions, and consciously self-correcting for about half an hour a day.

The more you try, the more practice you get, and the quicker you will come up the learning curve. It isn’t that hard, but you do have to work at it.

And working at it is more than just reading the five questions.

“What You Could Improve” Isn’t The Answer

In fact, suggestions on what to improve aren’t an appropriate answer when it’s the question.

Sometimes on discussion forums I see a practitioner asking questions like:

  • Who should the learner be?
  • What target should I assign?
  • Which, in turn, implies “Which lean tools should I use?”

I’ll break down the questions in another post. Right now, I want to discuss the common replies.

Replies come from well meaning people who leap to “You could apply SMED” or “It looks like you are trying to put in a pull system.”

In other words “Here are some improvements you could make.” without any grasp of:

  • The actual challenge being faced by the organization.
  • The current process operating patterns that are limiting moving to the next level.

So, the advice has no grounding in what must be done, only what could be done.

If I were to reframe the conversation to a different kind of problem, those replies wouldn’t make any sense at all:

“I am looking for help fixing my 2010 Toyota Tacoma*.”

  • “You could change the sparkplugs.”
  • “How about checking tire inflation?”
  • “This fuel additive works great.”
  • “What kind of fuel mileage are you getting?”

The first question should be “Tell me what about your 2010 Tacoma is currently unacceptable to you?”

“It’s stuck on a trail with a broken axle.” probably requires a different response than “It’s running rough in the morning.”

“Lean” is no different. What are you trying to accomplish here? is a question we don’t ever seem to ask. Why? Do we really think we have a pat set of answers that apply to any situation, or to any situation that seems similar to one we have encountered in the past?

________

*My Toyota truck (it predates the Tacoma) is a 1995 that has been driven the distance to the Moon, and is now on its way back.