27 September 2026
Measuring benefit without vanity metrics
Kill seat-count theatre. Reconcile to a frozen value case. Choose signals that change decisions across the twelve panes.
DIGITAL SKILL WORKS LTD / 12 PANES
Vanity metrics look good in decks and change no decision. Licensed seats, raw prompt counts, and unowned NPS sit in that bucket when they are not tied to a frozen case.
Vanity versus decision metrics
Vanity metrics look good in decks and change no decision. Licensed seats, raw prompt counts, and unowned NPS sit in that bucket when they are not tied to a frozen case.
Decision metrics change reclaim, expansion, risk spend, or kill criteria.
Anchor to the frozen case
Every benefit line should reconcile to assumptions you froze. If you cannot reconcile, rename the metric or drop it.
McKinsey’s 88 / 39 / 6 gap is a reminder that use metrics are not impact metrics. (McKinsey)
Signals by arc
SEE: readiness and shadow inventory coverage. STEADY: hotspot closure, register hygiene, cost reconcile, dormant reclaim. MOVE: habit retention, clinic conversion, task-map coverage. GROW: narrative coherence, learning loops, frontier kill/scale rate.
Pick a few. Run them on the operating rhythm.
Gartner’s ROI filter
Only 28 percent of AI use cases fully meet ROI expectations in the April 2026 I&O survey. 20 percent fail. Realistic cases and upfront preparation are the filter. (Gartner)
Close the journey loop
You built a window, faced the messy middle, saw before you scaled, walked Wave 0, hardened Security and GRC, proved cost and reclaim, redesigned work, met Counsel, took portfolio control, and changed how people work.
Measurement keeps that loop honest. Start again at /start when the next seat spray tempts you.
FAQ
How many metrics?
Fewer than you think. Enough to run weekly and monthly gates.
Can qualitative count?
Yes if defined and reviewed. Still say what you will not claim as EBIT.
Board pack tip?
One story, pane signals, owners, and the reconcile line. See Board pack.
Where do I see packages?
Series start?
Brand?
DIGITAL SKILL WORKS LTD / 12 PANES.
Series home: Why we built a window · Start · Framework
DIGITAL SKILL WORKS LTD / 12 PANES