General Information
Project description
OES is supporting the USAID-funded Integrated Family Planning Program (IFPP) in Mozambique led by Pathfinder International. The component of the IFPP that will be evaluated by OES is led by Population Services International (PSI). It aims to reach and engage urban women in Sofala and Nampula provinces at their doorstep with tailored family planning counseling specific to their needs, provided by family planning promoters. OES is supporting USAID/Mozambique efforts to increase the effectiveness of IFPP family planning promoters by providing them with additional tools to facilitate counseling beneficiaries and providing clinic referrals.
USAID/Mozambique is interested in learning more about different strategies to make the IFPP promoters as effective as possible, including but not limited to supplemental messaging directed at beneficiaries or promoter job aides. The aim is to increase the impact of the Agency’s development dollars. OES will also support USAID/Mozambique to measure the impact of these additional tools, through a rigorous evaluation.
The goal of the study is to use a randomized design to evaluate the effect of sending a series of mobile SMS follow-ups to beneficiaries who have received referrals for family planning services from an IFPP family planning promoter. The activity seeks to understand whether behaviorally informed SMS messages can be a cost-effective means of increasing the referral redemption rate among beneficiaries.
Detailed information
Final report: Is there a final report presenting the results and conclusions of this project?
Pre-analysis plan: Is there a pre-analysis plan associated with this registration?
Hypothesis
Effects of sending a series of mobile SMS follow-ups to beneficiaries who have received referrals for family planning services from an IFPP family planning promoter. The activity seeks to understand whether behaviorally informed SMS messages can be a cost-effective means of increasing the referral redemption
rate among beneficiaries.
How hypothesis was tested
RCT- sending a series of mobile SMS follow-ups to beneficiaries who have received referrals for family planning services from an IFPP family planning promoter VS business as usual
Dependent variables
The primary outcome of interest is the referral redemption rate. The raw data from DHIS2 contains individual records of issued referrals and which of these have been redeemed with nurses to be able to calculate this overall redemption rate.
Analyses
We will estimate the intent-to-treat (ITT) effect between the control group (no SMS messages) and the intervention group (SMS messages). We will estimate an ordinary least squares (OLS) regression of the binary outcome (redeemed referral) on intervention assignment for beneficiary i in strata s. The strata corresponds to a supervisor-date cell: i.e., all women who had been provided with a referral by promoters working under a certain supervisor, who were visited on a certain date
Sample Size. How many observations will be collected or what will determine sample size?
The trial will conclude following the larger of: seven months of enrollment or the enrollment of 5,000 women.
Data Exclusion
Information from individuals who do not provide consent to be part of the study or are not issued a referral are still recorded within the CwS application per standard data collection practices conducted by PSI-Mozambique. However, data access and analysis will pertain only to the sample that provided consent. All enrolled participants who provided consent will be included in the intent-to-treat analysis; any participant for whom we do not have a consent form on file will be excluded from analysis. In addition, there may be some limited cases of duplicate phone numbers in which the same number is registered twice; anecdotal evidence suggests that this primarily corresponds to cases in which two women share the same phone, and both are visited by promoters. These women will be included in the sample, but each pair jointly has a probability of assignment to treatment of 75% (and 25% of these women will be “doubly” exposed and receive messages twice.) In analysis, we will also present results excluding beneficiaries reporting duplicate phone numbers.
Treatment of Missing Data
Since PSI maintains a comprehensive administrative dataset and our analysis is restricted to the consenting participants, we do not expect true missing values. Any missing values for referral redemptions will be interpreted as absence of redemption (i.e.,“not redeemed”). We will not impute any covariates for those not reporting in the DHIS2 data.
However, data on message delivery will be provided by the SMS vendor that is managing the intervention and must be compiled and maintained by PSI. We are aware there is a significant risk of missing data here. If data is missing, we will code any recipients for whom delivery was not recorded as 1 for message delivery, thus ensuring a conservative estimate of the intervention’s implementation.
Mozambique
Maputo
Who is behind the project?
Project status:
Completed
Methods
What is the project about?
Date published:
7 June 2021