Products – The Centre for Independent Studies

Evaluating Indigenous programs: a toolkit for change

Sara Hudson
04 June 2017 | RR28
Evaluating Indigenous programs: a toolkit for change

The federal government recently announced it will allocate $10 million a year over four years to strengthen the evaluation of Indigenous programs. However, given that the average cost of an evaluation is $382,000, the extra $10 million a year for Indigenous program evaluations will not go far. To make the most of this additional funding the government must change the way it evaluates and monitors programs. Although formal evaluations for large government programs are important, evaluation need not involve outside contractors. Government must adopt a learning and developmental approach that embeds evaluation into a program’s design as part of a continuous quality improvement process.

It is not enough just to evaluate, government must actually use the findings from evaluations to improve service delivery. Unfortunately, many government agencies ignore evaluations when making funding decisions or implementing new programs.

Analysis of 49 Indigenous program evaluation reports, found only three used rigorous methodology. Overall, the evaluations were characterised by a lack of data and the absence of a control group, as well as an overreliance on anecdotal evidence.

Adopting a co-accountability approach to evaluation will ensure that both the government agency funding the program and the program provider delivering the program are held accountable for results. An overarching evaluation framework could assist with the different levels of outcomes expected over the life of the program and the various indicators needed to measure whether the program is meeting its objectives. Feedback loops and a process to escalate any concerns will help to ensure government and program providers keep each other honest and lessons are learnt.

Buy Hardcopy
Latest Publications

Mind the Gap: Understanding the Indigenous education gap and how to close it
Glenn Fahey
24 June 2021 | RR41

Indigenous educational disadvantage remains among the most pressing and persistent public policy challenges in Australia. Despite bipartisan and intergovernmental commitment to ‘Closing the Gap’, has done little to move the needle in education outcomes. Dispiritingly poor education outcomes persist despite the best of intentions, considerable investment of resources, and countless programmes and initiatives of policymakers. This research examines sources and…

READ MORE
Dollars and Sense: Time for smart reform of Australian school funding
Glenn Fahey
01 December 2020 | RR40

Australia is among the world’s highest-spending countries on schooling. Yet, the educational return on this investment for parents, taxpayers, employers, and students, has deteriorated — despite the expectation of policymakers that increased funding would inevitably improve educational outcomes. It’s true that money matters when it comes to schooling, but how money is used is what really matters, not how much…

READ MORE
Overcoming the Odds: A study of Australia’s top-performing disadvantaged schools
Blaise Joseph
18 March 2019 | RR39

Students from disadvantaged social backgrounds perform worse on average academically than more advantaged students. This study investigated Australia’s top-performing disadvantaged schools in terms of literacy and numeracy results, with the aim of finding any common policies and practices which have led to their success. Nine top-performing disadvantaged schools were visited by a researcher for this study, involving interviews with school…

READ MORE
Dying with Their Rights On: The myths and realities of ending homelessness in Australia
Carlos d'Abrera
12 December 2018 | RR38

The orthodox understanding of the causes of homelessness promoted by the ‘homelessness industry’ over emphasises the role of economic and social structures. Solutions based on structuralist explanations – such as increasing the supply of affordable social housing – are insufficient to reduce rough sleeping. Such approaches minimise the need to address assertively, the individual characteristics, choices, and behaviours of rough…

READ MORE
Why childcare is not affordable
Eugenie Joseph
29 August 2018 | RR37

Childcare fees and out-of-pocket costs in Australia have been growing above inflation in recent years, at the same time that more parents are using formalised childcare to support their participation in the workforce. Childcare has been subject to growing and evolving regulation for many years, culminating in the introduction of the National Quality Framework in 2012. However, the quality regulations…

READ MORE