Evaluating and monitoring for impact: developing a framework for risk prevention programs | Natural Hazards Research Australia

Evaluating and monitoring for impact: developing a framework for risk prevention programs

Photo: Matt Palmer, unsplash
Project type

Core research

Project status

In planning

This research project - through the evaluation of two contrasting case studies, an existing risk prevention program and the piloting of a novel program - will establish a national monitoring and evaluation framework for risk prevention programs which can be used by practitioners to understand the efficacy of their programs.

Project details

This project will establish a national framework for monitoring and evaluating risk prevention programs through: 

  • Work package 1: Evaluating the impact of the Queensland Fire and Emergency Services’ Fight Fire Fascination program, where fire services professionals supports parent and educators to teach children about fire safety through outreach. This package will seek to understand: 
    • the efficacy of the program against objectives, content, delivery and training 
    • the impact of the program on fire play and other behaviours 
    • how to monitor the efficacy of the program on an ongoing basis and build the capacity of staff to do so. 
  • Work package 2: Piloting and evaluating a novel program seeking to create targeted disaster preparedness videos delivered through wi-fi captive portals. The concept is designed to provide tourists and tourism workers, who are traditionally harder to reach with preparedness strategies, with targeted information on how to prepare for disasters in their area. Through the pilot, research will work closely with stakeholders at the sites selected for the pilot, to create buy-in and engagement. This package of work will create an understanding of: 
    • the effect of wi-fi captive portal videos have on disaster preparedness knowledge and perception of risk in tourists and tourism workers 
    • how tourists, tourism workers, and tourism businesses perceive and relate to disaster preparedness information delivered through Wi-Fi captive portal videos 
    • how to enhance wi-fi captive portal videos to improve disaster preparedness and user experience 
    • how the effectiveness and cost/benefits of wi-fi captive portal videos compare with disaster preparedness information delivered to transient populations through other channels 
    • how to pilot programs in a manner that can support future scaling to other applications and jurisdictions. 
  • Work package 3: The use of the two contrasting case studies, in combination with a literature review, will be used to create a recommended approach for the monitoring and evaluation of similar programs across jurisdictions. Researchers will disseminate their recommendations on monitoring and evaluation approaches to other agencies running risk prevention programs.