Skip to content
An official website of the OECD. Find out more
Created by the Public Governance Directorate

This website was created by the OECD Observatory of Public Sector Innovation (OPSI), part of the OECD Public Governance Directorate (GOV).

How to validate authenticity

Validation that this is an official OECD website can be found on the Innovative Government page of the corporate OECD website.

Increasing Effectiveness of Family Planning Promoters in Mozambique through an SMS Intervention

General Information

Project description

OES is supporting the USAID-funded Integrated Family Planning Program (IFPP) in Mozambique led by Pathfinder International. The component of the IFPP that will be evaluated by OES is led by Population Services International (PSI). It aims to reach and engage urban women in Sofala and Nampula provinces at their doorstep with tailored family planning counseling specific to their needs, provided by family planning promoters. OES is supporting USAID/Mozambique efforts to increase the effectiveness of IFPP family planning promoters by providing them with additional tools to facilitate counseling beneficiaries and providing clinic referrals.
USAID/Mozambique is interested in learning more about different strategies to make the IFPP promoters as effective as possible, including but not limited to supplemental messaging directed at beneficiaries or promoter job aides. The aim is to increase the impact of the Agency’s development dollars. OES will also support USAID/Mozambique to measure the impact of these additional tools, through a rigorous evaluation.
The goal of the study is to use a randomized design to evaluate the effect of sending a series of mobile SMS follow-ups to beneficiaries who have received referrals for family planning services from an IFPP family planning promoter. The activity seeks to understand whether behaviorally informed SMS messages can be a cost-effective means of increasing the referral redemption rate among beneficiaries.

Detailed information

Final report: Is there a final report presenting the results and conclusions of this project?

No

Pre-analysis plan: Is there a pre-analysis plan associated with this registration?

Yes

Hypothesis

Effects of sending a series of mobile SMS follow-ups to beneficiaries who have received referrals for family planning services from an IFPP family planning promoter. The activity seeks to understand whether behaviorally informed SMS messages can be a cost-effective means of increasing the referral redemption
rate among beneficiaries.

How hypothesis was tested

RCT- sending a series of mobile SMS follow-ups to beneficiaries who have received referrals for family planning services from an IFPP family planning promoter VS business as usual

Dependent variables

The primary outcome of interest is the referral redemption rate. The raw data from DHIS2 contains individual records of issued referrals and which of these have been redeemed with nurses to be able to calculate this overall redemption rate.

Analyses

We will estimate the intent-to-treat (ITT) effect between the control group (no SMS messages) and the intervention group (SMS messages). We will estimate an ordinary least squares (OLS) regression of the binary outcome (redeemed referral) on intervention assignment for beneficiary i in strata s. The strata corresponds to a supervisor-date cell: i.e., all women who had been provided with a referral by promoters working under a certain supervisor, who were visited on a certain date

Sample Size. How many observations will be collected or what will determine sample size?

The trial will conclude following the larger of: seven months of enrollment or the enrollment of 5,000 women.

Data Exclusion

Information from individuals who do not provide consent to be part of the study or are not issued a referral are still recorded within the CwS application per standard data collection practices conducted by PSI-Mozambique. However, data access and analysis will pertain only to the sample that provided consent. All enrolled participants who provided consent will be included in the intent-to-treat analysis; any participant for whom we do not have a consent form on file will be excluded from analysis. In addition, there may be some limited cases of duplicate phone numbers in which the same number is registered twice; anecdotal evidence suggests that this primarily corresponds to cases in which two women share the same phone, and both are visited by promoters. These women will be included in the sample, but each pair jointly has a probability of assignment to treatment of 75% (and 25% of these women will be “doubly” exposed and receive messages twice.) In analysis, we will also present results excluding beneficiaries reporting duplicate phone numbers.

Treatment of Missing Data

Since PSI maintains a comprehensive administrative dataset and our analysis is restricted to the consenting participants, we do not expect true missing values. Any missing values for referral redemptions will be interpreted as absence of redemption (i.e.,“not redeemed”). We will not impute any covariates for those not reporting in the DHIS2 data.
However, data on message delivery will be provided by the SMS vendor that is managing the intervention and must be compiled and maintained by PSI. We are aware there is a significant risk of missing data here. If data is missing, we will code any recipients for whom delivery was not recorded as 1 for message delivery, thus ensuring a conservative estimate of the intervention’s implementation.

Who is behind the project?

Institution: General Services Administration (GSA)
Team: Office of Evaluation Sciences (OES)

Project status:

Completed

Methods

Methodology: Experiment, Field Experiment
Could you self-grade the strength of the evidence generated by this study?: 1
Start date: 01/31/2020

What is the project about?

Policy area(s): Development, Health
Topic(s):
Behavioural tool(s): Prompts

Date published:

7 June 2021

Comments are closed.