Month: December 2021

Wanting Proof Positive: Reframing the “Measurable Outcomes” Problem

Posted on by Maya Mehta

One of the core beliefs of modern management is that if you cannot measure something, either it should not be undertaken or it does not exist. This conviction arises from our faith in the scientific method and the results-oriented outlook of the engineer and the economist. Thus, whenever a change is discussed, there will be an immediate demand for measurable outcomes and hard data that the change will improve the operations.

But what happens when what you value cannot be easily measured?

In fact, many of the things that matter most in your organization defy measurement. Let’s explore how to reframe the cult of measurability in order to ensure you pursue not only what “works” but what matters.

If You Acted On This Definition

If you’re starting with the aim of measurable outcomes, your course of action would include performing research to evaluate the project, and you’d likely bring in independent evaluators to do a pre-and post-intervention study.

Reframing “Measurable Outcomes”

Stop to think. You can measure the impact of a project to the extent that the organization can measure itself, which is a very elusive proposition in a human system. So what about a third party? The problem with bringing in outsiders to evaluate is that the evaluation has its own impact, and this may bring more interference than enlightenment.

Yet the economist in us justly wants to know how much this will cost. The engineer in us needs a test to affirm knowledge, a ruler to mark distance, a clock to demonstrate time. We justly want to know how to measure and know how we are doing. We need to know where we stand. But the question of measurable outcomes ceases to serve us when we think that measurement is so essential to being that we only undertake ventures that can be measured.

Measuring What Matters

Concrete measures can determine progress, but they do not really measure values. We pursue what matters independently of how well we can measure it. It is important to measure what we can, but to raise this question too early and to use it as a criterion that will determine whether or not to proceed runs the risk of worshipping too small a god.

What will matter most to us is the quality of experience we create in the world, not the quantity of results.

The real cost of creating something of value is emotional, not economic. What is most valuable cannot be purchased at a discount. The price of change is measured by our effort, our will and courage, and our persistence in the face of difficulty. The shift here is from an economic measure of cost to a personal measure of will.

Dealing With Doubt

It is important to recognize that our obsession with measurement is really an expression of our doubt. Doubt is fine, but no amount of measurement will assuage it. Doubt, or lack of faith, as in religion, is not easily reconciled, even by miracles, let alone by gathering measurable evidence on outcomes.

The wish to measure tightly is the recognition that every project has its own risks. Why not deal with the doubts and risks directly by naming them carefully right from the beginning? We cannot engineer human development, nor can we know it with the precision we might wish for. We can generate some data about the change, but most of it will be putting numbers on people’s feelings–that’s what surveys do. Why not just convene people every once in a while and ask them how it is going? Ultimately, we will know how we are doing by assessing the quality of our experience. If experience is such a good teacher, maybe it also knows how to measure.

To act within this new frame:

  1. Act on what matters, not just what works.
  2. Ensure you pursue what you truly value by asking the “why” questions before asking the “how” questions.
  3. Focus on quality of experience, not just quantity of results.

Where Else Is This Working? Reframing the “Guaranteed Success” Problem

Posted on by Maya Mehta

Business is risky. There is no way around it. You need to try new things to advance and yet you also somehow want a “guaranteed success.” Thus two major impulses are constantly in conflict: wanting to innovate and at the same time wanting the reassurance that what you are contemplating has been tried before. This is the paradox of success and safety.

How do you convince your stakeholders, and yourself, that the risks of the new venture are worthwhile?

The most attractive proof, of course, is an example of somewhere else the idea has worked well. This provides tangible evidence that this new opportunity will give you all-but-guaranteed success. But this is a false promise based on a faulty expectation. The answer is to reframe the problem.

If You Acted On This Definition

Based on the desire for a “guaranteed success” you would research examples of where what you propose is working. You would look for organizations in the same business as your client. You might arrange site visits, references, and a feasibility study.

Reframing “Guaranteed Success”

“Where else is it working?” seems like it’s a valid and compelling inquiry. Who would argue against learning from others? The problem is that the question perpetuates the belief that others know and we don’t. This does not mean that we cannot learn from others. It is just that asking “how” is a poor method of learning.

We learn by bearing witness to how others live their lives. We learn from the questions others have the courage to ask. We are more likely to be transformed from dialogue about what is real and what is illusion.

These conversations are qualitatively different from seeking methods and answers.

“Where else has this worked?” is a reasonable question, within limits. It is dangerous when it becomes an unspoken statement: If this has not worked well elsewhere, perhaps we should not do it.

The wish to attempt only what has been proven creates a life of imitation. We may declare we want to be leaders, but we want to be leaders without taking the risk of invention. The question can lead us down a spiraling trap: If what is being recommended or contemplated is, in fact, working elsewhere, then the next question is whether someone else’s experience is relevant to our situation—which, upon closer scrutiny, it is not.

The value of another’s experience is to give us hope, not to tell us how or whether to proceed.

While it is prudent to try to mitigate risk and do your homework, guaranteed success does not truly exist. Even if it is working somewhere else, there is no assurance that it will work here. Every new idea has to be customized locally. Although it is tempting, you risk making a false promise if you support the idea that a change can be imported with little risk into your client’s workplace. Although there may be much overlap in some details, there are always hidden factors that may have allowed success in one setting, but which would prevent it in another.

The Root: Doubt and Anxiety

So what can be done? The role of the consultant, in this case, is to help the client understand that behind their question of where it is working are doubt and anxiety. They have a wish for a guarantee that this “risky thing” will be successful. It would be strange if this were not present. Yet as a consultant working in partnership, you cannot make this promise because so much depends on the energy and investment of the client. Part of the work, therefore, is to help the client see that while wanting reassurance is natural, the expectation of a guarantee is driven by fear and is not realistic.

On the other side of the table, consultants can also face the tension between selling and consulting. You are really doing both but lean toward the consulting. Selling means your goal is to make the sale; consulting means the goal is to help the client make a good decision. Because there is a tension here, beware of any tendency to “oversell” a course of action, especially one that you have successfully pursued before. This inadvertently reinforces the false hope for “guaranteed success.”

Clients will make a better decision if they understand all that is required to make a change, especially at the local level. The field of consulting carries the shame of promising too much too soon. The search for what is working elsewhere might be useful, but can’t be a substitute for a willingness to try something new, with little more than your own faith as proof you are making a good decision.

To act in this new frame:

  1. Don’t assume that success elsewhere guarantees success here.
  2. Help the client and yourself by recognizing the place of doubt and anxiety in any new venture.
  3. Bring as much local knowledge to bear as possible. The more the idea is locally customized, the better chance it will succeed.

[Adapted from Peter Block, ‘Twelve Questions to the Most Frequently Asked Answers,’ The Flawless Consulting Fieldbook and Companion: A Guide to Understanding Your Expertise, 2001, pp. 401]

Taking It To Scale: Reframing the “Scalability” Problem

Posted on by Maya Mehta

Whenever a pilot project is successful, the question you can inevitably expect is “scalability.” How do you take this to scale and make the same thing happen across departments, or locations, or teams? It worked in one place, so let’s make it work in every place.

And let’s do it in a hurry.

For businesses under constant pressure to adapt and produce results, what could give a greater sense of safety than replicating “proven” methods?

But very often what worked in one place fails dismally in another.

This doesn’t mean the wish for scalability is wrong. But how can you reframe this classic problem in order to deliver the desired outcomes? Let’s explore.

If You Acted on This Definition

With the stated goal of taking the project “to scale,” your most likely course of action would be to standardize the elements of the pilot. Figure out the basic structure of the successful project and codify it into workable structures and procedures.

You would then obtain support from the top. Next, you would turn it into a program, hold a bunch of meetings, conduct training programs, set system-wide standards, and all the rest that has become stock in trade in change management.

Reframe “Scalability”

There is an underlying reason why this approach so often fails. Pilot projects work largely because people in one local site are engaged in creating them. Because they are locally engaged, they are able to act within the full scope of their own needs, circumstances, and knowledge. It is this act of engagement and creation that leads to high performance.

When you take something to scale and do it fast, the imaginative life is drained out of it. What you end up doing is to attempt to extract what is “universal” from what has worked locally. And usually, this means figuring out how to replicate certain outcomes rather than the creative processes that led to them. Therefore, when applied elsewhere, what once was a choice becomes coercion.

Nothing can be taken to scale. The success record of proliferation is poor.

The way to think about it is that, like politics, all change is local. You can’t easily copy and paste results from one locality to another. But what you can proliferate is the possibility of local invention following some loose guidelines and statements of purpose.

Don’t fall for the trap of thinking that top management is simply to blame for problems in “scalability.” Support from the top is not necessary to shape an organization of your choosing. Let top management set the mission. But every unit should be able to express its own vision of how best to organize and train itself in order to achieve that mission. This is the only way that the mission can be instantiated at the local level. Otherwise, the top’s inherent distance from the local circumstances will sabotage the ability to replicate the intended results.

Lastly, be prepared for this to take time. The wish to do something quickly is really a defense against local choice. It is the argument that we do not have time to engage a lot of people.

Don’t buy speed as an argument. Speed is a defense against depth and meaning. Nothing important happens quickly. Choose quality of experience over speed. The world changes from depth of commitment and capacity to learn.

To act within this frame:

  1. Don’t assume what worked “there” will work “here.”
  2. Engage local workers in the creative process of creating a vision for their unit.
  3. Go in for the long haul. Although engaging more people takes more time, it will produce more meaningful and resilient change.

[Adapted from Peter Block, ‘Twelve Questions to the Most Frequently Asked Answers,’ The Flawless Consulting Fieldbook and Companion: A Guide to Understanding Your Expertise, 2001, pp. 398-399]

When we offer a service primarily because clients want it, we have chosen commerce over care.