Explosive Risk: Measuring the Effectiveness of MRE Messaging Through Billboard and Radio

Client: UNMAS Afghanistan | Pillar: Social Development | Duration: 6 Months

Thematic Areas: Mine Risk Education

Services Provided: Monitoring and Evaluation

Challenge

  • Afghanistan is one of the most mined countries in the world, as 640,000 land mines have been dispersed since 1979

  • Over 31,000 casualties have been recorded between 1979 and 2018. In 2018 alone, 1,415 Afghan casualties were recorded. Children are also frequent victims and make up 80% of casualties

  • Many Afghans have low awareness of explosive hazards, engage in reckless behaviours that put them at risk, or are pressured by economic circumstances to intentionally engage in unsafe behaviours

  • Risk education has remained largely the same over the last two decades in Afghanistan and has failed to address the different social and behavioural drivers behind why individuals engage in unsafe behaviours

     

Our Social And Behavioural Insight

  • A sense of fatalism can be deeply engrained in parts of Afghanistan, and precludes a sense of personal agency when it comes to taking precautions against explosive hazards. Afghans may feel their destiny is not in their hands.

  • Current risk education materials are not aligned with SBC principles. They are too technical and focus on the danger of explosive hazards rather than engaging Afghans in an emotional, humane and relatable way.

  • Afghans may be overwhelmed by the “paradox of choice” when there are many behavioural options to choose from and it’s unclear what is the safe behaviour.

What We Did

Creative Ideation

  • MAGENTA designed new EORE materials for UNMAS to use their awareness sessions with Afghans, implemented across the country. These included:

  • 6 billboards

  • 1 notebook, including four sets of images

  • 3 posters

  • Each set of materials included a unique creative concept

Testing

  • MAGENTA designed an evaluation to measure the impact of a radio and billboard campaign to promote awareness and safe behaviours through a baseline, midline and endline assessment

  • MAGENTA tested the billboard designs in FGDs and provided recommendations on how to improve their efficacy based on the results

  • MAGENTA conducted the evaluation to determine the impact of the billboards and radio ads on behaviours and awareness.Communications approach

Methodology - Evaluation

MAGENTA conducted an evaluation based on data collected at three different points in time: 

  • Baseline data collected before the billboard and radio campaign began, between 8th – 21st March 2020

  • Midline data collected during the billboard and radio campaign, between 1st – 10th June 2020

  • Endline data collected at the end of the billboard and radio campaign, between the 6th – 16th August 2020

Each data collection exercise used quantitative phone surveys to measure the outcome-level indicators related to awareness, knowledge and behaviour change. 

The evaluation used a quasi-random sample of 395 respondents. Results can be considered representative of the telephone-owning Afghan population at the 95% confidence level and with a margin of error of 5%. 

Key Findings

The UNMAS radio and billboard campaign successfully reached a large proportion of Afghans in its target provinces

  • The radio messages had a higher reach than the billboards, and were more effective than billboards; respondents who were exposed to the radio ads saw their knowledge of explosive hazard risk increase more than respondents who saw the billboards.

  • Knowledge of the actions that can trigger the explosion of a mine remained stable over time; however, awareness of trigger actions was varied and men had higher knowledge of trigger actions than women. 

  • Awareness of the correct mechanism to report mines/ERWs (through a government phone number) is low and has remained so since the beginning of the evaluation.