Note
When Do We Stop Measuring AI Adoption?
AI usage can be a useful signal while organisations build capability. It becomes a poor destination if the objective is simply to make the number go up.
There is a perfectly reasonable stage of AI adoption where organisations want to know whether people are actually using the capability.
If you’ve provided tools, training and access and almost nobody uses them, that’s useful information.
But I wonder how long AI adoption itself should remain the target.
The number of people using AI tells us that people are using AI.
It doesn’t tell us that the organisation is better.
You could have extremely high adoption and no meaningful improvement in service, quality, cost or user experience. You could also have relatively concentrated use that transforms an important workflow.
Those are very different outcomes.
This becomes more important once adoption measures turn into targets.
If people are expected to demonstrate that they are using AI, they will find ways to use AI. The metric starts rewarding the presence of the tool rather than the value created through it.
That feels backwards.
The interesting questions are harder.
What can people now do that they couldn’t do before?
Which work became faster or better?
Where did quality improve?
What became cheaper to test?
Did users notice a better service?
Did people get more time for work requiring judgement?
Did anything important actually change?
Usage data still matters. It can help with licences, capacity, cost, security and understanding where a capability is spreading.
But observing usage is different from making usage the outcome.
Perhaps mature AI adoption starts when we stop measuring AI adoption.
Not because AI has become unimportant.
Because it has become ordinary enough that we measure the difference it makes instead.
Originally published on Threads.