Workforce Wonkery bee logo

Workforce Wonkery

Policy. Data. Practice. Decoded.

Data / Method validation

Regional Training Opportunity Model v1.1 Calibration Record

A five-market shadow test asked whether v1.1’s forward-looking workstream method is stable enough for production, and whether changing the weights from 35/35/30 to 40/30/30 would materially change the decisions.

Calibration PASSMarkets: Bakersfield-Delano · Redding · Modesto · San Luis Obispo-Paso Robles · San DiegoCompleted: September 22, 2026

The weights were not the fragile part.

Twenty-five candidate workstreams were scored twice using the same evidence: the production formula of 35% Structural / 35% Forward / 30% Actionability and an alternative of 40% Structural / 30% Forward / 30% Actionability.

Workstreams tested25
Mean score change0.39
Largest score change1.35
Status flips0
Rank positions changed2
Freeze decision: retain 35% Structural Opportunity + 35% Forward Signal + 30% Regional Actionability.
The alternative weighting produced no meaningful instability. The only rank movement was one top-two swap in Redding; no suggested status or final portfolio decision changed. Equal Structural and Forward weights better preserve v1.1’s intended role: projections establish the baseline, while credible current developments can matter before the baseline catches up.

The more important finding was portfolio discipline.

Several overlapping clusters can legitimately receive high scores because one major investment may create demand across construction, electrical, manufacturing, logistics, and technical occupations. That is useful evidence, but publishing all of them as separate priorities would double-count the same underlying regional decision.

MarketFinal Priority countExamples of what v1.1 changedPortfolio result
Bakersfield-Delano3Elevated space/defense and energy-system clusters; construction remained Watch because its current catalysts overlap the two stronger priorities.PASS
Redding3Forest resilience/heavy equipment and grid/wildfire utility work rose above a generic occupation-by-occupation framing.PASS
Modesto3Bioindustrial manufacturing became a distinct priority; allied health was consolidated into the broader clinical workforce decision.PASS
San Luis Obispo-Paso Robles4Diablo Canyon timing, aerospace/defense investment, healthcare expansion, and infrastructure became distinct actionable workstreams.PASS
San Diego-Chula Vista-Carlsbad5The large-market stress test retained five distinct systems: maritime manufacturing, healthcare, electrification, IT/cyber/defense, and water/construction infrastructure.PASS

Four guardrails are now frozen with the formula.

3–5 Priority workstreams

Each market should normally publish three to five distinct Priority workstreams. More than five requires an explicit exception in the publication gate.

Distinctiveness / overlap gate

High-scoring candidates should be consolidated or demoted when they rely on substantially the same catalyst, occupational base, and regional response.

Independent Actionability evidence

Every published Priority must have at least one Actionability source that is not merely the same event used as its strongest Forward Signal.

No double reward for one announcement

One development may inform both Forward Signal and Actionability only when it provides genuinely different evidence and another source independently supports the action case.

What changed from v1.0?

The calibration did not show that v1.0 was wrong. It showed that occupation-level decisions often become more useful when they are organized around the regional system that leaders can act on.

NEW CLUSTER

Emerging industries can surface earlier.

Space/defense in Kern, bioindustrial manufacturing in Modesto, and aerospace/defense in San Luis Obispo became visible as regional workstreams because current investment evidence connects related occupations that projections treat separately.

STRONGER WHY NOW

Existing priorities gain timing.

Nursing, electrical trades, forestry, utility technology, and healthcare capacity often pointed in the same direction as v1.0, but current developments made the reason to act now much clearer.

DEMOTION

High structural demand does not guarantee priority status.

Some construction or public-safety cases remained valuable but moved to Watch when current evidence was weaker or substantially overlapped another Priority workstream.

CONSOLIDATION

The unit of decision is the regional response.

Where two candidate workstreams required essentially the same partners, capacity response, and evidence, the calibration favored one broader workstream instead of publishing both.

Production decision

v1.1 is frozen for production. Future new-market workstream selection and substantive refreshes should use the 35/35/30 formula and the portfolio guardrails above. Published v1.0 briefs remain valid historical records until they receive a substantive refresh.

Calibration is a validation record, not a forecast. The shadow test evaluated method stability and decision usefulness using current structural and qualitative evidence. It does not imply that every forward signal will result in future employment.