Outcomes frameworks: one size fits none?
Whether standardised outcome measurement is possible or desirable across hugely diverse charitable organisations. The push for comparability versus the reality of complexity.
The debate in brief
The charity sector faces persistent pressure to demonstrate its impact through standardised outcomes frameworks — structured systems that define what success looks like, how it should be measured, and how results should be reported. Government commissioners, lottery distributors, trusts, and foundations increasingly require charities to adopt specific frameworks or report against predefined outcome indicators. The appeal is obvious: standardisation promises comparability, accountability, and evidence of value for money. But the sector's sheer diversity — from a two-person community group supporting isolated older people to a national homelessness charity operating across dozens of local authorities — makes genuine standardisation either impossible or actively misleading. The question is whether the pursuit of comparable data improves practice or distorts it.
Quick takeaways
| Question | Answer |
|---|---|
| What is an outcomes framework? | A structured system defining the outcomes a programme or service is expected to achieve, the indicators used to measure them, and the methods for data collection and reporting. |
| Why do funders want standardised outcomes? | To compare the effectiveness of different interventions, demonstrate value for money, and satisfy their own accountability requirements to government, donors, or the public. |
| Do charities support standardised measurement? | Views are divided. Larger charities with dedicated evaluation teams often support it. Smaller organisations frequently experience it as a burden imposed from outside that does not reflect their work. |
| What is the Outcomes Star? | A suite of outcome measurement tools developed by Triangle Consulting, widely used in homelessness, mental health, and other services. It uses a visual star diagram to track individual progress across multiple domains. |
| Does outcomes measurement improve services? | It can, when the measurement is designed with practitioners and beneficiaries and used for learning. It often does not when imposed externally and used primarily for reporting upward to funders. |
The arguments
Standardisation enables accountability and comparison
The case for standardised outcomes frameworks rests on a reasonable premise: if public money or charitable donations fund a service, there should be a credible way to assess whether that service works. Without common frameworks, every charity defines its own success criteria, collects its own data, and reports in its own format. Funders receive a patchwork of incomparable reports, making it impossible to assess relative effectiveness or to direct resources toward what works best.
Government commissioners have led this push. Outcomes-based commissioning, which ties contract payments or renewal to the achievement of predefined outcomes, requires a shared measurement framework. The National Lottery Community Fund, which distributes approximately £600 million per year, has developed its own outcomes approach and requires funded organisations to report against it. Trusts and foundations, including the Big Lottery Fund predecessors and various place-based funders, have invested in shared measurement initiatives — including the Inspiring Impact programme, led by a coalition including NCVO, New Philanthropy Capital, and others — to promote common standards.
The argument is not that every charity should measure the same things, but that organisations working in similar fields should adopt compatible frameworks. If ten charities provide mentoring for young people, standardised outcome measures allow comparison of their approaches and results, enabling better commissioning decisions and spreading effective practice.
Standardisation distorts what it claims to measure
The critique is that outcomes frameworks routinely confuse what is measurable with what matters. The aspects of charitable work most amenable to standardised measurement — numbers served, sessions delivered, self-reported satisfaction scores — are often the least meaningful indicators of genuine change. The aspects that matter most — shifts in confidence, rebuilding of trust, changes in family dynamics, long-term recovery — are complex, non-linear, and resistant to reduction into comparable data points.
New Philanthropy Capital's own research has acknowledged this tension. Its 2014 report "Building Your Evidence Base" noted that the most important outcomes are often the hardest to measure, and that an overemphasis on quantifiable indicators can lead organisations to focus on what they can count rather than what counts. The Charities Evaluation Service, before its merger with NCVO, made similar observations about the risk of measurement frameworks driving behaviour rather than reflecting it.
The problem is compounded by the power dynamics of who designs the framework. When a commissioner specifies outcomes, they embed their own assumptions about what success looks like. A homelessness service may be measured on "move-on rates" — the speed at which people leave supported accommodation — rather than on the sustainability of that move or the person's own assessment of their wellbeing. A youth service may be judged on school attendance rather than on the relationships, safety, and belonging that make attendance possible. The framework becomes a proxy for the commissioner's priorities, not a genuine account of what the service achieves.
The burden falls hardest on those least able to bear it
The practical cost of outcomes measurement is not evenly distributed. Large charities with dedicated evaluation and data teams can absorb the demands of multiple funders' frameworks, invest in data systems, and employ staff to manage reporting. Small and medium-sized charities — which make up the vast majority of the sector — experience outcomes requirements as an unfunded administrative burden.
The Lloyds Bank Foundation's research on small and medium-sized charities has consistently found that reporting requirements consume a disproportionate share of their resources. When different funders require different frameworks, the same organisation may be running parallel data collection systems for the same service, duplicating effort without improving practice. The Foundation's "Value of Small" report documented how the administrative demands of outcomes reporting actively disadvantage smaller organisations in commissioning processes, favouring larger charities with the infrastructure to comply.
The Institute for Voluntary Action Research (IVAR) has published extensive work on the gap between funders' information needs and charities' capacity to meet them. Its "Open and Trusting" grant-making research found that many charities experience reporting requirements as a compliance exercise disconnected from their own learning and improvement. The data flows upward to funders but rarely flows back in a form that helps the organisation improve its work.
The evidence
IVAR's research has consistently found that charity leaders spend more time on funder-required data collection than on using data to improve their services, with the burden falling disproportionately on smaller organisations. Its surveys have also found that many charities are reporting against multiple different outcomes frameworks simultaneously, duplicating effort without improving practice.
New Philanthropy Capital's State of the Sector research has tracked the adoption of outcomes measurement over the past decade. While adoption has increased — particularly among organisations receiving government contracts or National Lottery funding — the evidence that standardised measurement has improved service quality or commissioning decisions is thin. NPC's own assessments have noted that the quality of outcomes data varies enormously and that comparisons between organisations using the same framework are often unreliable due to differences in how data is collected, the populations served, and the contexts in which services operate.
The Outcomes Star, developed by Triangle Consulting Social Enterprise, is one of the most widely adopted standardised tools in the UK. Research published by Triangle and by independent evaluators has found that the Star can be useful as a practitioner tool — helping keyworkers structure conversations with service users about their progress — but that its value as a comparative dataset across organisations is limited by inconsistencies in how it is administered and scored.
The Inspiring Impact programme, which ran from 2012 to 2022, aimed to create a culture of impact measurement across the sector. Its final evaluation acknowledged significant progress in raising awareness of impact measurement but found limited evidence that the quality of outcomes data had improved at a sector-wide level, or that the data produced was being used effectively to improve commissioning decisions.
Current context
The push toward outcomes measurement shows no sign of abating. The National Lottery Community Fund's current strategic framework requires funded organisations to report against a set of outcome indicators, and government commissioners continue to embed outcomes-based specifications in contracts across social care, public health, criminal justice, and employment services.
However, there are signs of a counter-movement. IVAR's "Open and Trusting" initiative has attracted growing funder support for simplified, trust-based reporting. The Lloyds Bank Foundation, Lankelly Chase Foundation (now Collaborative Fund for Systems Change), and several community foundations have publicly committed to reducing reporting burdens and accepting narrative-based accounts of impact alongside or instead of standardised metrics. The Funders' Collaborative Hub has promoted alignment of reporting requirements to reduce duplication.
The effective altruism movement, which emphasises rigorous cost-effectiveness analysis and randomised controlled trials, has pushed the measurement debate in a different direction — arguing not for standardised frameworks but for higher-quality evidence about what works. This has influenced some UK funders but has also drawn criticism for privileging interventions amenable to quantitative evaluation over those addressing complex, systemic problems.
Last updated: April 2026
What this means for charities
Charities face a practical challenge: outcomes measurement is required by most funders, but the way it is typically implemented serves funders' needs more than the organisation's own learning.
First, charities should develop their own theory of change before adopting any external framework. Understanding what your organisation believes it changes, and how, is the foundation for meaningful measurement. An externally imposed framework adopted without this groundwork produces compliance data, not insight.
Second, where possible, charities should negotiate reporting requirements with funders. Many funders are more flexible than their application forms suggest. Presenting a clear, internally coherent approach to understanding your impact — even if it does not match the funder's standard template — is increasingly accepted, particularly by trusts and foundations influenced by the trust-based philanthropy movement.
Third, charities should be honest about what they can and cannot measure. Claiming precise, quantified outcomes for complex human change processes risks undermining the organisation's credibility when the data does not hold up to scrutiny. Honest accounts of what the organisation observes, what service users report, and what remains uncertain are more credible and more useful than spurious precision.
Common questions
What is a theory of change?
A theory of change is a description of how and why an organisation believes its activities lead to the outcomes it seeks. It typically maps the causal pathway from inputs and activities through outputs and intermediate outcomes to long-term impact. A well-developed theory of change identifies assumptions, external factors, and the evidence base for the causal links. It provides the logical foundation for deciding what to measure and why.
Are outcomes frameworks mandatory?
No outcomes framework is legally required. However, many funders — including government commissioners and the National Lottery Community Fund — require funded organisations to report against specific outcome indicators or to use designated tools. For charities dependent on these income streams, the frameworks are effectively mandatory in practice if not in law.
What is the difference between outputs and outcomes?
Outputs are the direct products of an activity — the number of people served, sessions delivered, or meals provided. Outcomes are the changes that result — improved wellbeing, increased employment, reduced reoffending, better health. The distinction matters because high outputs do not necessarily produce good outcomes. A service can deliver hundreds of sessions without meaningfully changing anyone's circumstances.
Do standardised frameworks work in any context?
They work best in well-defined, relatively homogeneous service areas where the intervention is consistent, the population is comparable, and the outcomes are clearly defined. Drug and alcohol treatment, smoking cessation, and some employment programmes have benefited from standardised outcome measurement. They work least well in complex, relational, community-based work where the outcomes are emergent, long-term, and shaped by factors outside the organisation's control.
Why do funders keep requiring different frameworks?
Because there is no single agreed standard, and because different funders have different accountability structures. A government commissioner reports to elected members and ultimately to taxpayers. A lottery distributor reports to Parliament. A trust or foundation reports to its trustees. Each has different questions, different timescales, and different tolerances for uncertainty. The result is a patchwork of overlapping requirements that charities must navigate individually.
What is trust-based philanthropy?
Trust-based philanthropy is a funding approach that shifts power toward grantees by providing unrestricted funding, simplified applications, reduced reporting requirements, and multi-year commitments. Originating in the US, it has gained traction among UK funders including the Lloyds Bank Foundation, Esmee Fairbairn Foundation, and several community foundations. Its advocates argue that trusting organisations to understand their own impact produces better outcomes than imposing external measurement frameworks.
Key sources and further reading
IVAR: Open and Trusting Grant-Making — Institute for Voluntary Action Research. A programme of research and practice on trust-based approaches to funding and reporting, including evidence on the impact of reporting burdens on small charities.
New Philanthropy Capital: Building Your Evidence Base — NPC, 2014. Guidance on impact measurement for charities, including discussion of the tension between measurability and meaningfulness.
Lloyds Bank Foundation: The Value of Small — Lloyds Bank Foundation. Research on the distinctive contribution and structural disadvantages of small and medium-sized charities, including the disproportionate burden of outcomes reporting.
Triangle Consulting: Outcomes Star — Triangle Consulting Social Enterprise. Documentation and research on the Outcomes Star suite of tools, including evidence on their use in homelessness, mental health, and other services. outcomesstar.org.uk
Inspiring Impact Programme: Final Evaluation — NPC, 2022. Assessment of the sector-wide initiative to promote impact measurement culture across UK civil society.
National Lottery Community Fund: Outcomes Approach — NLCF. The Fund's current approach to outcomes measurement, including required indicators and reporting guidance. tnlcommunityfund.org.uk
Charity Commission: CC9 — Campaigning and Political Activity — Charity Commission. While focused on campaigning, relevant to the question of whether charities should challenge the measurement systems imposed on them.
Charities Evaluation Service (archived) — Merged with NCVO. Published foundational guidance on outcomes measurement for UK charities, including practical toolkits and critical analysis of framework design.