Designing and Evaluating Explanations of Aid Program Eligibility Criteria

Policy Context

This project designs and rigorously evaluates different digital approaches to improve uptake and beneficiary comprehension of social protection programs. In collaboration with GiveDirectly, the research team intends to conduct a randomized controlled trial in which households will be delivered explanations of program eligibility through different digital mediums. Researchers will measure success and acceptability along several dimensions: comprehension, perceptions of program legitimacy, social cohesion, and respect for dignity.

Study Design

The primary focus of research efforts thus far have been to work with GiveDirectly to identify an upcoming cash transfer program that is suitable; a program where researchers will be able to randomize the digital channel that explanations are delivered through. While this project has been slowed down by changes in the development landscape and personnel changes at GiveDirectly, the research team expects to randomize the explanations in an upcoming cash transfer program in Rwanda. The program is part of a large and ongoing collaboration between GiveDirectly and the Government of Rwanda to digitize social protection. This change is particularly exciting because it will allow researchers to also evaluate the use of a cutting-edge Kinyarwanda AI Voice Assistant, in addition to SMS, interactive voice response, and a call center. This shift in scope allows the research to speak to the efficacy of cutting-edge AI application in development.

Results and Policy Lessons

This pilot is ongoing and findings are forthcoming.