Practice Approach evaluation and survey
Published: June 7, 2024 · Updated: March 4, 2025
As part of the Practice Approach trial, a series of evaluation activities were undertaken to support continuous improvement and early learnings for a national rollout.
Background
The Practice Approach offers relational, inclusive, and restorative practice that benefits all tamariki and whānau. It is framed by Te Tiriti o Waitangi, supported by a mana-enhancing paradigm for practice, and draws from Te Ao Māori principle of oranga. The Practice Approach is delivered through a practice framework and a suite of new models, tools, and resources.
The Practice Approach trial began in August 2022. Six sites in Tāmaki Makaurau-Auckland and Ōtautahi – Christchurch participated. The evaluative activities and data sources included the following:
- A survey of kaimahi at the trial sites (Stage – 1) – completed in August 2023
- A formative evaluation based on interviews, case file analysis and the Stage – 1 survey – completed in June 2024
- A survey of kaimahi at the trial sites (Stage – 2) – completed in August 2024
- Thematic analysis of qualitative data from focus groups and case file analysis – completed in December 2024.
Key findings
Key highlights from the evaluative activities are set out below:
- Kaimahi at trial sites have positively embraced the new practice approach.
- Oranga Tamariki practice at trial sites has shifted with kaimahi gradually building their confidence and understanding of how to use of the new framework in practice. Kaimahi reported working more rationally and proactively with risk to resolve things.
- The practice approach having a stronger alignment with Te Ao Māori values. Kaimahi reported that the approach encouraged kaimahi to undertake a culturally aligned approach when working with tamariki and whānau.
- The practice framework and the new models, tools, and resources when used as designed, work and make a difference in analysis and practice judgement.
- A clear articulation of the Practice Approach purpose and how the framework, models, tools and resources work in practice is needed.
- The investment in supervisors is crucial. The evaluation highlighted the need to invest in supervisors’ development needs, and their understanding of the new framework, use of associated tools and what quality mahi looks like.
- Ongoing support and encouraging leadership is critical for desired cultural shifts, such as moving from descriptive and fuller case noting to succinct and purposeful recording that culminates in an assessment report. Supportive and encouraging leadership is needed also for a shift from peremptory child removal to working relationally to understand and resolve risk and harm.
- Challenges which kaimahi reported of the new Practice Approach implementation included inconsistency in guidance, differences in how teams worked, variation in leadership, workload and time constraints, and frequent changes in documents and templates to use.
- The proactive and working with risk approach of the new practice framework differs from how risks and harm are constructed at a wider system level. Evidence suggests that a good understanding of the Practice Approach and confidence in using the framework helped explain and clarify how kaimahi reached their view and practice judgements.
Research files
-
Practice Approach evaluation report Stage 1 final report
A formative evaluation based on interviews, case file analysis and the Stage – 1 survey – completed in June 2024
Pdf, 2.1 MB
-
Practice Approach evaluation survey Stage 1 final report
A survey of kaimahi at the trial sites (Stage – 1) – completed in August 2023
Pdf, 1.2 MB
-
Practice Approach Survey Kia Ū August 2024
A survey of kaimahi at the trial sites (Stage 2) – completed in August 2024
Pdf, 8.3 MB
-
Practice Approach evaluation Focus groups report
Thematic analysis of qualitative data from focus groups and case file analysis – completed in December 2024
Pdf, 526 KB