Demonstration, engagement and follow through
Following the initial in-country visit, we returned to Tonga to host a design workshop with representatives from DFAT, Tonga Health, various government ministries and agricultural business people. We continued to learn how best to include cultural aspects of Tongan life in the program, to ensure the concept we presented resonated appropriately with Tongan children, parents and officials, while remaining curriculum-aligned and hitting key learning outcomes.
We then developed a plan to socialise the resources with educators and parents to ensure schools and communities supported the program. Our subsequent trips to Tonga focused solely on community and stakeholder engagement, including visits to the 11 pilot schools, to continually reaffirm commitment to the program.
In order to evaluate against our key learning outcomes, we developed a robust data-capture strategy that included in-app and external activities.
Being able to track meaningful data from the app usage was built into the solution design from the beginning. Millipede has previous experience in developing apps for use in remote areas and has developed systems and policies for tracking and storing anonymised usage data, for later synchronisation.
We conducted baseline and end-of-pilot surveys with children and teachers in pilot schools, so we could compare pre- and post-trial understandings. Qualitative interviews were conducted with teachers and parents, while informal workshops were conducted with small groups of children to further observe interactions.
The evaluation has identified six notable outcomes of the pilot:
There was a measurable improvement in students’ knowledge about healthy and unhealthy foods after engaging with the Our Special Island materials
Before using the app, only 3% of children in the trial population correctly identified the healthy foods in a set of healthy and unhealthy options; whereas post-trial, 81% correctly identified the healthy foods. Furthermore, post-trial 94% listed a healthy food as a favourite, compared to 60% pre-trial.
Students had begun to connect their digital play interactions with their off-screen world
Students in the majority of pilot schools had begun to demonstrate an increased interest in healthy food and healthy eating at school and in their homes.
Students remained engaged with the app throughout the pilot
Students across all pilot schools were as excited to use the app at the end of the pilot as they were at the beginning. In some cases, the app usage data indicated that levels of engagement appeared higher at the end of the pilot.
Teachers welcomed the iPads in their classroom and enjoyed using them
Teachers across the majority of pilot schools embraced the iPad and the Our Special Island app to the point that all but one teacher requested more iPads in the classroom at the end of the pilot.
Use of the Our Special Island materials varied significantly across schools
The usage rates of the Our Special Island play-based app across schools ranged from 184 sessions to just two sessions over the six-week period.
The pilot and suite of resources were, on the whole, culturally appropriate, engaging, and accessible
Feedback received on the Our Special Island pilot from participating teachers, parents of participating students and key pilot stakeholders indicate that the pilot resources were well received.
The full Monitoring, Evaluation and Learning Report for the Our Special Island pilot is available for download.
The results show a significant positive shift in most children’s attitudes towards healthy food. The observations and feedback from teachers and parents has been both encouraging and inspiring. We are currently focusing on a Tonga-wide rollout, a strategy for sustaining the program long-term. We’ll be repurposing some material for additional use-cases and developing a model that will ensure sustainability into the future.
We are actively seeking funding partners to help us realise our five-year plan for Our Special Island across the Pacific—we aim to achieve:
- Our Special Island being used in more than 80% of GPS schools in Tonga and Samoa
- ambassador programs employing local representatives in Tonga and Samoa
- reaching thousands of students across hundreds of classrooms
- supporting teachers across Tonga and Samoa to embrace play-based learning
- Our Special Island having an international presence outside of the Pacific region
- a measurable impact and contribution in the fight against NCDs.