Evidence & measurement

“How will we know it’s working?”

If you wait for wage records, you’ll wait a decade. Working programs run on leading indicators now and build the longitudinal spine for later.

The straight answer

What the evidence actually says

First, an honest statement about the field: universal-participation models like Winchester's have no published outcome studies yet — the earliest cohorts are only now becoming measurable. That is both a caution against overselling and an opportunity: districts that measure well from day one will own evidence the whole field needs. (Our library includes a full feasibility blueprint for exactly that kind of longitudinal study.)

The practical architecture has three layers. Leading indicators from day one: attendance and engagement, course-taking patterns, dual-enrollment credits, industry credentials earned (in North Carolina's data, 80.6% of CTE concentrators earned a pathway credential), graduation, and first destinations. A comparison strategy if you can manage one — matched schools or cohorts beat before/after every time. The long game through your state's longitudinal data system, which can link graduates to postsecondary enrollment and, eventually, earnings.

Two disciplines keep the numbers honest. Disaggregate everything — the benefits of these programs concentrate (the landmark Career Academies trial found earnings gains strongest for young men), and gendered program sorting is a documented failure mode, so an explicit equity metric belongs on the KPI scorecard from the start. And match program capacity to real regional demand: the outcome evidence weakens sharply where genuine openings are scarce. A program built on labor-market wishful thinking will produce disappointing numbers no measurement system can fix.

First moves

30 / 90 / 365 days

Sequenced, not simultaneous. The 30-day moves cost little and buy you room; the year is where the change becomes structure.

First 30 days

  • Define the pilot’s KPI scorecard before launch: 5–8 leading indicators, including one explicit equity metric, with baselines.
  • Identify your comparison: a matched school, a prior cohort, or district-wide averages — decided now, not retrofitted later.

By 90 days

  • Stand up the data routine: who pulls what, monthly, and who sees it. A binder nobody opens is not a measurement system.
  • Register the program’s completers correctly in state reporting so credentials and concentrator status are captured.

Within the year

  • Publish a plain-language annual report to the community — participation, credentials, destinations, disaggregated.
  • Open the longitudinal conversation with your state data system or a university partner, using our feasibility blueprint as the template.

Carry the work

What carries this