An AES project team was tasked with establishing a policy position on what constitutes quality evaluation that makes a difference. Their work has involved a high level review of relevant academic literature and key documents, a review of other international voluntary evaluation societies and their positions, and initial member consultation undertaken at the aes25 Evaluation Conference.
As a result, the team have identified 6 elements of quality evaluation that makes a difference to test with members.
The 6 elements are:
1. It has a clear purpose and is useful. Quality evaluation is designed to address questions that matter to commissioners and stakeholders, to provide accountability, inform decisions, and informs learning and improvement. It makes a difference by generating findings that are timely, relevant and actionable.
2. It is well-reasoned and uses proportionate judgement. Quality evaluation produces judgements supported by credible, transparent reasoning that links evidence to conclusions. It makes a difference by drawing on appropriate methods and forms of knowledge in proportion to the scale, complexity and risk of the initiative.
3. It is legitimate, has authority and is relational. Quality evaluation is conducted in ways that are accountable to people, place and community. It makes a difference by enabling those with cultural, community or lived expertise to play a meaningful role in defining value, interpreting evidence and shaping conclusions.
4. It acknowledges multiple knowledge systems. Quality evaluation draws on scientific, professional, lived and cultural knowledge, without assuming that any single form is universally sufficient. It makes a difference by ensuring that the weight given to different forms of knowledge is determined in context, with appropriate authority.
5. It reflects ethical practice that strengthens and sustains relationships. Quality evaluation is conducted in ways that are appropriate for the people, places and communities involved, and enables people with diverse perspectives and experience to participate. It supports people and communities to make informed choices about when and how they engage and contributes to the capability of people, communities and systems. It makes a difference by recognising that evaluation is not only a means of judgement, but a practice that strengthens relationships and leaves systems better able to learn over time.
6. It is delivered by competent practitioners who are reflective. Quality evaluation requires practitioners who have the knowledge, skills and judgement to do the work well, and the humility and self-awareness to recognise the limits of their own perspectives and values. It makes a difference through its competent delivery which includes technical and methodological capability, cultural understanding, relational skill and the capacity for reflective practice.
More detail of the project's foundations, activities and a description of each element can be found in the linked attachment (
Quality Evaluation that Makes a Difference - Consultation Paper).
This survey can be completed without reading the backgrou