FE-006 · Field Essay

1.0 The dashboard is filling up

AI adoption is becoming visible.

The dashboards are filling up. Licenses issued. Active users counted. Prompts submitted. Training completed. Hours saved. Workflows touched. Champions named. Productivity reported.

For many organizations, this feels like progress.

And in one sense, it is.

A technology that was experimental two years ago is now entering ordinary work. Employees are trying it. Leaders are funding it. Vendors are embedding it. Learning teams are teaching it. Governance teams are beginning to surround it.

But beneath the adoption story, a harder question remains.

What evidence shows that people are becoming more capable?

Not more active.

Not more confident.

Not merely faster.

More capable.

Can they frame the right problem before asking AI to solve it? Can they recognize when a fluent answer is weak? Can they challenge an output that sounds plausible? Can they decide what must be verified elsewhere? Can they protect sensitive context? Can they escalate uncertainty? Can they explain the reasoning behind the final recommendation? Can they still act when the familiar prompt, tool, or workflow disappears?

These questions are harder to count.

But they are closer to the real management problem.

AI adoption leaves visible exhaust. Human capability does not. It has to be observed through the quality of work, judgment, challenge, verification, and responsibility.

This is the gap now opening inside enterprise AI enablement.

Organizations are becoming better at measuring the spread of AI. They are still much weaker at measuring whether AI use is building durable human capability.

Kyndryl’s 2026 People Readiness reporting gives the gap a useful enterprise expression: AI may be embedded or broadly deployed while workforce readiness remains far behind.Kyndryl

Clio’s Australian Legal Insights Report shows the same pattern in a sector-specific way: very high reported AI use does not automatically mean deep workflow integration.Clio

These are different studies, populations, and constructs. They should not be treated as one dataset. Their value is that they point toward the same structural question.

Adoption is becoming visible. Capability remains under-evidenced.


2.0 The category error

Many AI dashboards answer useful questions.

But they often answer one question and are then treated as evidence for another.

Licenses and access

Can show: The opportunity to use AI.

Cannot prove by itself: Actual use, quality of use, judgment or competence.

Active users and prompt volume

Can show: Frequency of interaction.

Cannot prove by itself: Whether the interaction was useful, appropriate, verified or responsible.

Course completion

Can show: Exposure to a learning intervention.

Cannot prove by itself: Application, retention or transfer into unfamiliar work.

Confidence and satisfaction

Can show: Perceived self-efficacy and reduced friction.

Cannot prove by itself: Actual performance, verification or appropriate escalation.

Reported time saved

Can show: Perceived efficiency.

Cannot prove by itself: Output quality, risk, causality or capability development.

Workflow adoption

Can show: Operational integration.

Cannot prove by itself: Responsible individual capability under changing conditions.

None of these signals should be dismissed. They are valuable leading and operating indicators. They help leaders see diffusion, friction, access, participation, and perceived usefulness.

The problem begins when they are asked to prove capability.

Capability is not participation.

Capability is demonstrated in the way a person uses AI to achieve a meaningful outcome while retaining the judgment, verification, and responsibility the situation requires.

That requires a different class of evidence.

A high adoption rate can coexist with shallow use. High confidence can coexist with poor verification. Faster output can coexist with declining quality.


3.0 What current measures can and cannot prove

A mature enterprise AI programme will measure adoption.

It should.

Leaders need to know whether the technology is available, whether people can access it, whether training is reaching the workforce, whether adoption differs by role, and whether early use cases appear valuable.

But the more sophisticated the programme becomes, the more visible the boundary becomes.

CVS Health offers a constructive example. Its AI Learning Academy reports more than 18,500 live-session attendances, improved colleague confidence, and follow-up productivity gains reported by participants.CVS Health

CVS also describes a persona-based learning model tailored to business priorities, workflows, and use cases rather than a generic one-size-fits-all rollout.CVS Health

That is not a weak programme.

It is a serious one.

It shows reach. It shows intentionality. It recognizes that AI capability is context-dependent. It goes beyond generic awareness training. It attempts to connect learning to workplace value.

Those are meaningful signals.

But even meaningful signals have boundaries.

From the outside, they do not yet tell us whether the resulting work was more accurate or merely faster. They do not tell us whether participants recognized cases where AI should not be used. They do not tell us whether people detected plausible but incorrect outputs. They do not show whether productivity gains persisted beyond familiar use cases. They do not establish whether employees became more capable or more dependent on a particular tool, workflow, or support environment.

That is not a criticism of CVS.

It is the point.

The more mature an AI learning programme becomes, the more important the next question becomes: what evidence demonstrates transferable capability?

Attendance is not transfer.

Confidence is not verification.

Time saved is not judgment.

Adoption is not readiness.

A strong enterprise AI programme should measure all of these things.

But it should not confuse them.


4.0 Faster is not always more capable

The argument for capability evidence is not an argument against productivity.

Productivity matters. Speed matters. Time saved matters. AI adoption will continue to be justified, in part, by its ability to reduce repetitive work, widen access to useful expertise, and improve throughput.

The question is whether productivity is a sufficient proxy for human capability.

It is not.

Research on generative AI in customer support found an average productivity increase, but also showed that the effects differed by experience and skill level. The same tool did not produce the same pattern for everyone.Stanford Digital Economy LabQuarterly Journal of Economics

This matters because averages are comfortable.

Capability is not.

An average time saving may hide role-specific, experience-specific, and quality-specific effects. Speed and quality can move in different directions. Performance with assistance may reflect the combined performance of the person, the AI system, the workflow, and the support environment.

That creates the management problem.

What capability is being strengthened, and what capability is being substituted?

A person may become faster because AI helps them think better.

A person may also become faster because AI thinks on their behalf and they stop checking.

Both can look productive.

Only one is capability-building.


5.0 What capability must mean now

For enterprise AI, capability should not mean enthusiasm.

It should not mean tool access.

It should not mean the ability to generate polished output.

AI capability is the demonstrated ability to use AI intentionally and appropriately to achieve a meaningful outcome while retaining the judgment, verification, and responsibility the situation requires.

This definition changes what leaders should look for.

Capability is demonstrated. It is evidenced through action, not simply declared through self-assessment.

Capability is contextual. Using AI well to draft a routine email does not prove readiness to use it in a clinical, legal, financial, safety-critical, or high-consequence operational decision.

Capability includes appropriate non-use. A capable person may refuse to delegate a task to AI, restrict what information is supplied, seek authoritative evidence elsewhere, escalate to a qualified expert, or complete part of the work without AI.

Capability includes retained responsibility. The employee remains responsible for understanding the intended outcome, recognizing constraints, interpreting the output, deciding what requires verification, resolving uncertainty, and accepting responsibility for the recommendation or action that follows.

This is why AI Fluency cannot be reduced to prompt engineering.

Prompting may be part of it. Tool familiarity may be part of it.

But AI Fluency, in the Coincentives sense, is broader.

AI Fluency is the discipline of governed human–AI collaboration: making intent, authorship, verification, accountability, and traceability visible while AI participates in the work.

Related Field Essay

Conceptual foundation

FE-003 — From Human Agency to Agentic Readiness

Agentic Readiness explains why AI adoption is not enough when human agency, decision ownership and traceability must remain meaningful.


6.0 Capability appears closest to the work

Quizzes can test terminology.

Simulations can test standardized performance.

Training exercises can test whether people understood an instruction.

All of these have a place.

But they do not fully reproduce the texture of real work.

Real work contains ambiguous goals, incomplete information, conflicting stakeholder demands, organizational constraints, imperfect data, time pressure, unclear accountability, and consequences outside the test environment.

It also contains temptation.

This is why authentic or realistic work provides a different class of evidence.

NIST’s ARIA programme is not a workforce capability assessment programme, and it should not be presented as endorsing Coincentives or AFA. Its evaluation philosophy is still relevant: the ARIA pilot studied people interacting with AI applications in scenario-based settings because conventional evaluation can miss real-world risks, impacts, and interaction patterns.NIST ARIA Pilot Evaluation Report

The principle translates cleanly into the workforce context.

If capability is meant to operate in real work, at least some of the evidence should come from realistic or authentic human–AI work.

The point is not that every employee must be intensively assessed on every task.

That would be excessive, expensive, and potentially intrusive.

The point is that adoption telemetry alone cannot show how people work with AI when the task becomes ambiguous, the output becomes questionable, or the consequences become material.

Some evidence needs to be closer to the work itself.


7.0 The evidence ladder

A credible capability model should not begin with a score.

It should begin with context.

1. Context

What outcome was the person trying to achieve? What role did they hold? What constraints, consequences, data and tools shaped the work?

2. Collaboration process

How did they frame the problem, provide or withhold context, direct AI, respond to weak output, seek evidence, and decide where human judgment remained necessary?

3. Outcome evidence

Did the work satisfy the relevant constraints? Were alternatives considered? Were material errors identified and resolved? Did a usable artifact, recommendation or decision result?

4. Transfer and retention

Can the capability survive a new task, a different model, a weaker output, a new domain, or a situation where the person must explain and defend the final decision?

Without context, the same behaviour can be interpreted incorrectly.

A person who gives little context to AI may be careless in one setting and appropriately protective in another. A person who refuses to use AI may be resistant in one setting and professionally responsible in another. A person who challenges an output repeatedly may be inefficient in one setting and correctly cautious in another.

Context makes evidence interpretable.

Collaboration process makes judgment visible.

Outcome evidence connects behaviour to usable work.

Transfer shows whether capability survives outside the familiar pattern.

Evidence becomes stronger as it moves from declared confidence toward observed action, meaningful outcomes, unfamiliar conditions, and consistency over time.


8.0 From people to operating systems

A mistake would be to aggregate individual scores and call the result workforce readiness.

That would be too narrow.

Organizational readiness is not only the sum of individual capability.

It also depends on workflow design, data access, tool access, decision rights, policies, human checkpoints, escalation routes, exception handling, management support, monitoring, and accountability.

An employee may lack capability because training was insufficient. But they may also fail because the policy is unclear, the workflow gives them no time to verify, the tool does not expose provenance, the manager rewards speed over judgment, the escalation path is missing, or the organization has not defined who owns the final decision.

Capability evidence should help leaders separate different kinds of gaps.

This is the difference between an AI adoption dashboard and an AI capability system.

The first tells leaders where AI is spreading.

The second helps them understand whether AI use is becoming reliable, responsible, transferable, and governable.

Related Field Essay

Enterprise enablement foundation

FE-004 — Enterprise AI Enablement Is a Management System Refresh, Not a Tool Rollout

FE-004 develops the management-system argument behind capability, governance, baselines, incentives and operating-model redesign.


9.0 Literacy is becoming a governance responsibility

The regulatory context reinforces this shift, but it must be handled carefully.

For providers and deployers within scope, Article 4 requires measures supporting the development of AI literacy, taking account of people’s knowledge, experience, training and context of use. It does not require organizations to test every employee, guarantee a specified level of individual AI literacy, use a particular assessment method or obtain a certificate.European Commission

So the argument should not be overstated.

The AI Act does not turn capability evidence into a single mandated product category.

But it does make one thing clearer: AI literacy, skills, context, and oversight are becoming organizational responsibilities.

NIST’s AI Risk Management Framework points in a similar direction from a governance perspective. It calls for operator and practitioner proficiency processes, human oversight processes, context of use, and interpretation of AI outputs in context to be defined, assessed, and documented.NIST AI RMF

These are not merely training questions.

They are governance questions.

They require organizations to understand who is using AI, for what purpose, under what constraints, with what oversight, and with what ability to interpret and challenge the output.

In other words: capability has to become more visible.


10.0 Seven questions for the AI dashboard

Does the dashboard measure opportunity, activity, or capability?

Can it distinguish speed from quality?

Does it preserve relevant context?

Does it show how employees respond when AI is wrong?

Does it reveal transfer across tasks, tools, models or conditions?

Does it protect employees from surveillance and misuse?

Can the organization act on the findings?

If the response to every capability gap is more training, the diagnostic is incomplete.

Some gaps require training. Others require clearer policies, better systems, redesigned workflows, explicit decision rights, stronger escalation paths, better managerial support, or different incentives.

A capability dashboard should not merely produce a number.

It should improve the organization’s ability to govern AI-enabled work.


11.0 The objections are real

There are reasonable objections to this argument.

One objection is that usage is the best available practical measure.

That is partly true. Usage is often easier, cheaper, and less intrusive to measure than capability. It helps leaders understand diffusion and adoption barriers.

But usage becomes misleading when it is presented as proof of effective or responsible capability.

Another objection is that business outcomes are all that matter.

Business outcomes matter.

But aggregate outcomes can conceal uneven capability, unnoticed quality deterioration, growing dependence on a tool, weak performance under unfamiliar conditions, or a governance failure waiting for a higher-consequence case.

Capability evidence helps explain whether positive outcomes are repeatable and resilient.

A third objection is that authentic assessment cannot scale.

That is also partly true.

Not every employee or task requires intensive observation. Not every situation justifies deep assessment. A sensible model is layered: adoption telemetry for breadth, surveys for perception, outcome metrics for value, sampled or bounded authentic-work evidence for depth, and team-level aggregation for organizational decisions.

The answer is not to assess everything.

The answer is to stop pretending that thin evidence is thick evidence.

The final objection is more serious: observing work with AI can become surveillance.

It can.

If poorly designed, capability measurement can become intrusive, punitive, and self-defeating. A defensible model must therefore be purpose-limited, time-bounded, transparent, data-minimized, and clear about who can see what. It should distinguish developmental evidence from hidden performance monitoring. It should aggregate where organizational insight is the objective. It should make explicit when observation begins and when it ends.

This is not a side issue.

It is central.

If the goal is to preserve human agency, the measurement system must not become another way to erode it.


12.0 The next dashboard

AI adoption is increasingly easy to demonstrate.

The dashboards are filling up: more licenses, more active users, more training, more prompts, more workflows, more reported hours saved.

Those measures matter.

But they describe the spread of a technology.

They do not, by themselves, prove the development of human capability.

The next stage of enterprise AI enablement requires a different question: can people use AI to achieve sound outcomes while retaining the judgment, verification, and responsibility the work requires?

Answering that question requires evidence closer to the work itself.

Evidence of how people frame problems.

Evidence of how they collaborate with AI.

Evidence of how they challenge outputs.

Evidence of what they produce.

Evidence of how they respond when AI fails.

Evidence of whether their capability transfers when the task, tool, or consequence changes.

This is where AI Fluency becomes important.

Not as a slogan. Not as prompt skill. Not as generic AI literacy.

AI Fluency is the discipline of governed human–AI collaboration. It is the human capability layer that helps organizations see whether AI use is strengthening judgment or merely hiding dependency.

This is also where AFA fits.

AFA Coach develops AI Fluency through ongoing work. AFA Assessment measures performance within a deliberately bounded evidence window. Skill Accolades recognizes demonstrated capability through evidence-backed, verifiable recognition.

Not as a replacement for adoption analytics, training programmes, governance frameworks, or business outcome measures.

AFA addresses a narrower and deeper problem: turning meaningful work with AI into evidence of how a person collaborates with AI while preserving intent, authorship, verification, accountability and traceability.

For individuals, that evidence can support reflection, development and a session-bound performance result. For teams, it can help reveal patterns: where capability is emerging, where confidence is ahead of performance, where verification is weak, where dependency risk is rising, and where the organization needs better workflows or governance rather than more training alone.

The point is not to abandon adoption measurement.

It is to stop asking adoption measurement to prove more than it can.

If your dashboard shows access, usage, completion, confidence, and time saved, you have an AI adoption dashboard. The next question is what you would need to add before you could call it a capability dashboard.


Turn doctrine into evidence

AI Fluency Accelerator (AFA) Coach helps people develop AI Fluency through meaningful work. AFA Assessment measures performance in a deliberately bounded, goal-based assessment session. Skill Accolades can turn demonstrated capability into evidence-backed, verifiable recognition. Assessment produces a session-bound performance result; qualifying patterns demonstrated over time can support Proof-of-Skill recognition.


AI Fluency is a leading indicator of Agentic Readiness: the capability to work with increasing AI autonomy while preserving human agency, judgment, accountability, and traceability.