Grant Ledger

Measurement

Part of Small business grants measurement: baselines, costs and honest limits

Finding grant benchmarks that match your geography, period and cost basis

Research defensible benchmarks for a small business grant by matching geography, period, population, cost basis, outcome definitions and evidence quality.

A benchmark is useful only when the compared measure means roughly the same thing. Match geography, period, population, intervention, quality and cost basis before using another programme's number to judge an England small business project.

What to take away

  • A benchmark is useful only when the compared measure means roughly the same thing.
  • Match geography, period, population, intervention, quality and cost basis before using another programme's number.
  • Prefer primary records and check the population behind every table.
  • Normalise currency date, VAT treatment, project duration and cost scope with care.
  • When no defensible benchmark exists, use the project's own baseline instead of manufacturing market authority.

Define the question

State whether the benchmark will test price, unit cost, delivery time, reach, output quality or outcome. Write the internal measure specification first. Research cannot find a comparable value for an undefined metric.

Decide the acceptable range of comparability. A board planning estimate may tolerate more uncertainty than a formal claim that one programme outperformed another.

Set inclusion criteria

Record the required geography, business size, sector, intervention type, delivery model, period and unit. State exclusions. Search England-specific official material first, then UK evidence with a clear scope note, followed by global material only when it remains relevant.

Do not silently treat UK, Great Britain and England as interchangeable. Check the population behind every table.

Prefer primary records

Use official statistics, published evaluations, programme reports, audited accounts and first-party methodology. Record title, publisher, URL, publication date, data period, table or page and access date.

The government's Evaluation Registry guidance explains the registry for planned, live and completed central government evaluations from April 2024. That makes it a discovery source for applicable government work, not proof that a particular study matches a business project.

The Magenta Book provides a framework for judging process, impact and value-for-money evidence. Read the actual evaluation method and limitations, not just its headline.

Normalise with care

Align currency date, VAT treatment, nominal or real prices, project duration, participant definition and cost scope. Separate full economic cost, public funding and recipient contribution.

For a cost-per-output comparison, confirm that both numerator and denominator cover the same activity and time. Do not compare approved budget in one programme with paid cost in another.

Assess evidence quality

Check sample size, missing data, selection, counterfactual, sensitivity and conflicts. A large programme can still publish a weak causal claim; a small study can provide useful process evidence without estimating impact.

The government's Quality in Policy Impact Evaluation guidance distinguishes observed outcome change from evidence that an intervention caused it. Preserve that distinction when importing a result.

Build a benchmark range

Where several comparable records exist, present their distribution and context rather than selecting the most favourable figure. Explain outliers and avoid a calculated average when underlying definitions differ.

When no defensible benchmark exists, say so. Use the project's own baseline, target assumptions and later actuals, clearly labelled, instead of manufacturing market authority.

Document the research

Keep the search date, terms, sources screened, criteria, extraction, conversions and reviewer. Schedule an update when the benchmark is time-sensitive. Quote no number without its period and source.

Present the result for review

Build an evidence table with one row per source. Show the original measure, normalised measure, conversions, comparability judgement and limitation. Keep rejected records in a separate log so another reviewer can see why they were excluded.

Use a range when evidence varies and explain what drives it. If one record differs because it includes capital costs and another excludes them, do not hide the distinction inside an average. State which point or range informed the project target and why.

Ask a second person to reproduce at least one extraction and every material conversion. When the source changes or disappears, retain the permitted record, retrieval date and enough citation detail to verify what was used.

This draft contains no live internal links. It remains on hold until a named researcher applies the method to a specific metric and an independent reviewer checks comparability.

Before you act

  • Define the metric and acceptable comparability range first.
  • Record required geography, business size, sector, intervention, period and unit.
  • Use official statistics, published evaluations and first-party methodology.
  • Align currency date, VAT treatment and cost scope before comparing.
  • Present a benchmark range and explain outliers.
  • Document search date, terms, sources and reviewer.

Common questions

Why should I avoid treating UK, Great Britain and England as interchangeable?

The article warns that these terms cover different populations, so you must check the population behind every table. Using a UK figure for an England small business project may mislead because the underlying geography and population differ.

What should I do if no defensible benchmark exists?

The article says to say so and use the project's own baseline, target assumptions and later actuals, clearly labelled. Do not manufacture market authority. This keeps the comparison honest and avoids false precision.

How should I handle differences in cost scope between programmes?

Separate full economic cost, public funding and recipient contribution. Do not hide distinctions inside an average. State which point or range informed the project target and why, and explain what drives the variation.

More in Measurement

Measurement

Small business grants measurement: baselines, costs and honest limits

Measure and report an England small business grant project using clear baselines, outputs, outcomes, costs, evidence, attribution and limitations.

Measurement

Did the grant cause the result? Attribution methods from before-and-after to contribution analysis

Compare practical attribution methods for a small business grant project, from before-and-after monitoring to comparison groups and contribution analysis.

Measurement

Grant project metrics across finance, delivery, outputs, outcomes and fairness

Choose practical metrics for an England small business grant project across finance, delivery, outputs, outcomes, reach, quality and evidence.

Measurement

Grant measurement mistakes, from missing baselines to claiming causation from timing

Avoid 10 common small business grant measurement mistakes involving baselines, definitions, double counting, attribution, costs and data quality.