References

456 | Revisiting Targeting in Social Assistance

agricultural extension workers. Sometimes nongovernmental organizations also dispatch their own frontline staff to be a member of the Area Executive

Committee. 88. In Mali’s Jigisemejiri program, the committees are paid for their attendance, which represents a significant operational cost, but program administrators use committees for other functions.

References

Aiken, Emily, Suzanne Bellue, Dean Karlan, Christopher R. Udry, and Joshua

Blumenstock. 2021. “Machine Learning and Mobile Phone Data Can Improve the Targeting of Humanitarian Assistance.” NBER Working Paper 29070,

National Bureau of Economic Research, Cambridge, MA. Alatas, Vivi, Abhijit Banerjee, Rema Hanna, Benjamin A. Olken, Ririn Purnamasari, and Matthew Wai-Poi. 2019. “Does Elite Capture Matter? Local Elites and

Targeted Welfare Programs in Indonesia.” AEA Papers and Proceedings 109: 334–39. https://doi.org/10.1257/pandp.20191047. Alatas, Vivi, Abhijit Banerjee, Rema Hanna, Benjamin A. Olken, and Julia Tobias. 2012. “Targeting the Poor: Evidence from a Field Experiment in Indonesia.”

American Economic Review 102 (4): 1206–40. Al-Iryani, Lamis, Alain de Janvry, and Elisabeth Sadoulet. 2015. “The Yemen Social

Fund for Development: An Effective Community-Based Approach amid

Political Instability.” International Peacekeeping 22 (4): 321–36. Areias, Ana, Niall Keleher, Laura Ralston, and Matthew Wai-Poi. Forthcoming. “Big

Data, Machine Learning and Prediction in the Targeting of Social Protection

Programs.” World Bank, Washington, DC. Banerjee, Abhijit, Rukmini Banerji, Esther Duflo, Rachel Glennerster, and Stuti

Khemani. 2010. “Pitfalls of Participatory Programs: Evidence from a

Randomized Evaluation in Education in India.” American Economic Journal:

Economic Policy 2 (1): 1–30. Basurto, Maria Pia, Pascaline Dupas, and Jonathan Robinson. 2020. “Decentralization and Efficiency of Subsidy Targeting: Evidence from Chiefs in Rural Malawi.”

Journal of Public Economics 185 (104047). Baum, Tinatin, Anastasia Mshvidobadze, and Josefina Posadas. 2016. Continuous

Improvement: Strengthening Georgia’s Targeted Social Assistance Program. Directions in Development Human Development. Washington, DC: World Bank. https:// openknowledge.worldbank.org/handle/10986/24812. Beegle, Kathleen, Joachim De Weerdt, Jed Friedman, and John Gibson. 2012.

“Methods of Household Consumption Measurement through Surveys:

Experimental Results from Tanzania.” Journal of Development Economics 98 (1): 3–18. https://ideas.repec.org/a/eee/deveco/v98y2012i1p3-18.html. Ben-Avie, Jochai, and Udbhav Tiwari. 2019. “India’s New Data Protection Bill:

Strong on Companies, Step Backward on Government Surveillance.” Blog:

Open Policy & Advocacy, December 10. https://blog.mozilla.org/netpolicy /2019/12/10/indias-new-data-protection-bill-strong-on-companies-weak -on-gov.

How to Harness the Power of Data and Inference | 457

Bergeron, Gilles, Saul Sutkover Morris, and Juan Manuel Medina Banegas. 1998.

“How Reliable Are Group Informant Ratings? A Test of Food Security Rating in

Honduras.” World Development 26 (10): 1893–902. Björkegren, Daniel, Joshua E. Blumenstock, and Samsun Knight. 2020.

“Manipulation-Proof Machine Learning.” ArXiv:2004.03865 [Cs, Econ], April. http://arxiv.org/abs/2004.03865. Blondel, Vincent D., Adeline Decuyper, and Gautier Krings. 2015. “A Survey of

Results on Mobile Phone Datasets Analysis.” EPJ Data Science 4 (1): 10. Blumenstock, Joshua, Gabriel Cadamuro, and Robert On. 2015. “Predicting Poverty and Wealth from Mobile Phone Metadata.” Science 350: 1073. https://doi .org/10.1126/science.aac4420. Blumenstock, Joshua, and Nathan Eagle. 2010. “Mobile Divides: Gender,

Socioeconomic Status, and Mobile Phone Use in Rwanda.” Proceedings of the 4th

ACM/IEEE International Conference on Information and Communication Technologies and Development 6: 1–6. ICTD 2010, New York. Blumenstock, Joshua, and Nathan Eagle. 2012. “Divided We Call: Disparities in

Access and Use of Mobile Phones in Rwanda.” Information Technologies &

International Development 8 (2): 1–16. Boko, Joachim, Luis Alberro, Maimouna Gueye, Audrey Ariss, and Tina George. 2020. “Technology & Innovations for Africa’s Human Capital in the Face of the

Covid-19 Crisis: Technical Note on Togo’s Novissi Program.” World Bank,

Washington, DC. Bourguignon, François, Francisco H. G. Ferreira, and Phillippe G. Leite. 2008.

“Beyond Oaxaca–Blinder: Accounting for Differences in Household Income

Distributions.” Journal of Economic Inequality 6 (2): 117–48. Brown, Caitlin, Martin Ravallion, and Dominique van de Walle. 2016. “A Poor

Means Test? Econometric Targeting in Africa.” NBER Working Paper No. 22919, National Bureau of Economic Research, Cambridge, MA. Buolamwini, Joy, and Timnit Gebru. 2018. “Gender Shades: Intersectional Accuracy

Disparities in Commercial Gender Classification.” Proceedings of Machine Learning

Research 81: 1–15. Camacho, Adriana, and Emily Conover. 2011. “Manipulation of Social Program

Eligibility.” American Economic Journal: Economic Policy, 3 (2): 41–65. Carraro, Ludovico. 2014. “Ajutorul Social Assessment Report.” World Bank,

Washington, DC. Carrillo, Alfredo, Luis F. Cantú, Luis Tejerina, and Alejandro Noriega. 2021. “Individual

Explanations in Machine Learning Models: A Case Study on Poverty Estimation.” arXiv:2104.04148v2 [cs.LG]. https://arxiv.org/abs/2104.04148. Chambers, Robert. 1994. “Participatory Rural Appraisal (PRA): Challenges,

Potentials and Paradigm.” World Development 22 (10): 1437–54. ISSN 0305750X, https://doi.org/10.1016/0305-750X(94)90030-2. Chi, Guanghua, Han Fang, Sourav Chatterjee, and Joshua E. Blumenstock. 2021.

“Micro-Estimates of Wealth for all Low- and Middle-Income Countries.”

Working Paper, Cornell University, Ithaca, NY. Coady, David, Margaret Grosh, and John Hoddinott. 2004. Targeting of Transfers in

Developing Countries: Review of Lessons and Experience. Washington, DC: World

Bank. https://openknowledge.worldbank.org/handle/10986/14902.

458 | Revisiting Targeting in Social Assistance

Coady, David, Samir Jahan, Riki Matsumoto, and Baoping Shang. 2021. “GMI

Schemes in Europe: Landscape and Design.” IMF Working Paper WP/21/179,

International Monetary Fund, Washington, DC. Conning, Jonathan, and Michael Kevane. 2002. “Community-Based Targeting

Mechanisms for Social Safety Nets: A Critical Review.” World Development 30 (3): 375–94. Cook, Benjamin Lé, and Willard G. Manning. 2013. “Thinking beyond the Mean: A

Practical Guide for Using Quantile Regression Methods for Health Services

Research.” Shanghai Archives of Psychiatry 25 (1): 55–59. Corral Rodas, Paul, Isabel Molina, and Minh Nguyen. 2021. “Pull Your Small Area

Estimates Up by the Bootstraps.” Journal of Statistical Computation and Simulation. https://doi.org/10.1080/00949655.2021.1926460. Council of Ministers. 2005. “Decision No. 787/2005 on Determining the Criteria and Procedures of Economic Assistance Levels.” Council of Ministers, Tirana,

Albania. CRES (Centre des Recherches et des études Sociales) and World Bank. 2018.

“Evaluation des données administratives Relative au Revenu des Ménages en

Tunisie.” World Bank, Washington, DC. Datt, Gaurav, and Martin Ravallion. 1991. “Regional Disparities, Targeting, and

Poverty in India.” In Including the Poor, edited by Michael Lipton and Jacques van der Gaag, 91–114. Washington, DC: World Bank. de Montjoye, Yves-Alexandre, Sébastien Gambs, Vincent Blondel, Geoffrey

Canright, et al. 2018. “On the Privacy-Conscientious Use of Mobile Phone

Data.” Scientific Data 5: 180286. https://doi.org/10.1038/sdata.2018.286. del Ninno, Carlo, and Bradford Mills. 2015. Safety Nets in Africa: Effective Mechanisms to Reach the Poor and Most Vulnerable. Washington, DC: World Bank. https://doi .org/10.1596/978-1-4648-0435-9. Deville, Pierre, Catherine Linard, Samuel Martin, Marius Gilbert, Forrest R. Stevens,

Andrea E. Gaughan, Vincent D. Blondel, and Andrew J. Tatem. 2014. “Dynamic

Population Mapping Using Mobile Phone Data.” Proceedings of the National

Academy of Sciences 111 (45): 15888–893. Diamond, Alexis J., M. Gill, M.A. Rebolledo Dellepiane, Skoufias, E., Vinha, K.,

Xu, Y. 2016. “Estimating Poverty Rates in Target Populations: An Assessment of the Simple Poverty Scorecard and Alternative Approaches.” World Bank

Policy Research Working Paper No. 7793, https://ssrn.com/abstract =2836540. Dong, Yuxiao, Yang Yang, Jie Tang, and Nitesh V. Chawla. 2014. “Inferring User

Demographics and Social Strategies in Mobile Social Networks.” In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data

Mining, 15–24. New York. Eagle, Nathan, Michael Macy, and Rob Claxton. 2010. “Network Diversity and

Economic Development.” Science 328 (5981): 1029–31. Elbers, Chris, Jean O. Lanjouw, and Peter Lanjouw. 2003. “Micro–Level Estimation of Poverty and Inequality.” Econometrica 71 (1): 355–64. Engstrom, Ryan, Jonathan Samuel Hersh, and David Newhouse. 2021. “Poverty from Space: Using High-Resolution Satellite Imagery for Estimating Economic

Well-Being.” The World Bank Economic Review, lhab015, https://doi.org/10.1093 /wber/lhab015.

How to Harness the Power of Data and Inference | 459

Fatehkia, Masoomali, Isabelle Tingzon, Ardie Orden, Stephanie Sy, Vedran Sekara,

Manuel Garcia-Herranz, and Ingmar Weber. 2020. “Mapping Socioeconomic

Indicators Using Social Media Advertising Data.” EPJ Data Science 9: 22. https://doi.org/10.1140/epjds/s13688-020-00235-w. Fay, Robert E., and Roger A. Herriot. 1979. “Estimates of Income for Small Places:

An Application of James-Stein Procedures to Census Data.” Journal of the

American Statistical Association 85: 398–409. https://doi.org/10.1080/01621459. 1979.10482505. Feulefack, Joseph, and Manfred Zeller. 2005. “How Accurate Is Participatory Wealth

Ranking (PWR) in Targeting the Poor? A Case Study from Bangladesh.”

Conference on International Agricultural Research for Development, Stuttgart-

Hohenheim, Germany, October 11–13. Filmer, Deon, and Lant H. Pritchett. 2001. “Estimating Wealth Effects without

Expenditure Data—or Tears: An Application to Educational Enrollments in

States of India.” Demography 38 (1): 115–32 (accessed August 19, 2020), www .jstor.org/stable/3088292. Fortmann-Roe, Scott. 2012. “Understanding the Bias-Variance Tradeoff.” https:// scott.fortmann-roe.com/docs/BiasVariance.html. French Republic. 2016. “LOI No. 2016-1321 of October 7, 2016 for a Digital

Republic.” 2016-1321. https://www.legifrance.gouv.fr/jorf/id/JORFTEXT0000 33202746?r=LhMomAa3M7. Frias-Martinez, Vanessa, and Jesus Virseda. 2012. “On the Relationship between

Socio-Economic Factors and Cell Phone Usage.” Proceedings of the Fifth

International Conference on Information and Communication Technologies and

Development, 76–84. New York. GAO (Government Accountability Office). 2020, “Audit of the Data Act.” GAO,

Washington, DC. https://www.gao.gov/assets/gao-20-540.pdf. Geisser, Seymour. 1975. “The Predictive Sample Reuse Method with Applications.”

Journal of the American Statistical Association 70 (350): 320–28. Gelb, Alan, and Anna Diofasi Metz. 2018. “Identification Revolution: Can Digital ID

Be Harnessed for Development?” Brief, Center for Global Development,

Washington, DC. Golan, Jennifer, Terry Sicular, and Nithin Umapathi. 2014. “Any Guarantees?

China’s Rural Minimum Living Standard Guarantee Program.” Social Protection and Labor Discussion Paper No. 1423, World Bank Group, Washington, DC. https://openknowledge.worldbank.org/handle/10986/1997. Government of Kyrgyz Republic. 2018. “Resolution 307 on the Implementation of the Law on State Benefits in the Kyrgyz Republic.” Bishkek, Kyrgyz Republic. Greene, William H. 2011. Econometric Analysis, seventh ed. Pearson. ISBN-13: 9780131395381, ISBN-10: 0131395386. Günther, Isabel, and Kenneth Harttgen. 2009. “Estimating Household Vulnerability to Idiosyncratic and Covariate Shocks: A Novel Method Applied in Madagascar.”

World Development 37 (7): 1222–34. Handa, Sudhanshu, Carolyn Huang, Nicola Hypher, Clarissa Teixeira, Fabio V.

Soares, and Benjamin Davis. 2012. “Targeting Effectiveness of Social Cash

Transfer Programmes in Three African Countries.” Journal of Development

Effectiveness 4 (1): 78–108.

460 | Revisiting Targeting in Social Assistance

Hardt, Moritz, Nimrod Megiddo, Christos Papadimitriou, and Mary Wootters. 2015.

“Strategic Classification.” arXiv:1506.06980 [cs.LG]. https://arxiv.org/abs /1506.06980. Head, Andrew, Mélanie Manguin, Nhat Tran, and Joshua E. Blumenstock. 2017.

“Can Human Development Be Measured with Satellite Imagery?” Proceedings of the Ninth International Conference on Information and Communication Technologies and Development. Article 8. https://doi.org/10.1145/3136560.3136576. Hill, Kashmir. 2020. “Wrongfully Accused by an Algorithm.” New York Times,

August 3, Technology Section. https://www.nytimes.com/2020/06/24 /technology/facial-recognition-arrest.html. Hill, Ruth V., and Catherine Porter. 2017. “Vulnerability to Drought and Food Price

Shocks: Evidence from Ethiopia.” World Development 96: 65–77. Hillis, Samira, Phillippe Leite, Laura McDonald, and Lillian Frost. 2013. “Designing an Advanced Cash Transfer Program in the Palestinian Territories.” MENA

Knowledge and Learning Quick Notes No. 98, World Bank, Washington, DC. Himmelstine, Carmen Leon, and Anna McCord. 2012. “The Use of Community-

Based Targeting in Low- and Middle-Income Countries.” Annotated

Bibliography, Overseas Development Institute, London. Holzmann, Penny, Tanya Boudreau, Julius Holt, Mark Lawrence, and Michael

O’Donnell. 2008. The Household Economy Approach: A Guide for Programme

Planners and Policy-Makers. New York: Save the Children. https://resourcecentre .savethechildren.net/node/13676/pdf/hea_guide.pdf. Honorati, Maddalena, Roberto Claudio Sormani, and Ludovico Carraro. 2020.

“Assessing the Targeting System in Georgia: Proposed Reform Options.”

Social Protection and Jobs Discussion Paper No. 2005, World Bank,

Washington, DC. https://openknowledge.worldbank.org/handle/10986 /34358. License: CC BY 3.0 IGO. i2i Dime and the World Bank. 2017. “Field Experiments on Targeting Labor

Intensive Public Works in Eastern Congo.” World Bank, Washington, DC. https://www.jobsanddevelopment.org/wp-content/uploads/2019/04 /Congo_LIPW.pdf. James, Gareth, Daniela Witten, Trevor Hastie, and Robert Tibshirani. 2013. An

Introduction to Statistical Learning with Applications in R. New York: Springer Verlag. Jean, Neal, Marshall Burke, Michael Xie, W. Michael Davis, David B. Lobell, and

Stefano Ermon. 2016. “Combining Satellite Imagery and Machine Learning to

Predict Poverty.” Science 353 (6301): 790–94. Kebede, Bereket. 2009. “Community Wealth Ranking and Household Surveys: An

Integrative Approach.” Journal of Development Studies 45: 1731–46. https://doi .org/10.1080/00220380902935832. Kidd, Stephen. 2011. “Targeting the Poorest: An assessment of the Proxy Means

Test Methodology.” Australian AID, Canberra, Australia. https://doi.org /10.13140/2.1.3567.6488. Kidd, Stephen, Bjorn Gelders, and Diloá Bailey-Athias. 2017. “Exclusion by Design:

The Effectiveness of the Proxy Means Test.” ESS Working Paper No. 56,

International Labour Office, Development Pathways, Sidcup, UK. Koenker, Roger, and Gilbert Bassett, Jr. 1978. ”Regression Quantiles.” Econometrica 46 (1): 33–50.

How to Harness the Power of Data and Inference | 461

Kuhn, Max, and Kjell Johnson. 2018. Applied Predictive Modeling. New York: Springer. Lain, Jonathan. 2018. “Multi-Dimensional Urban Poverty in Indonesia.” World

Bank, Washington, DC. Lange, Simon, Stephan Klasen, Grace Hadiwidjaja, Juul Pinxten, and Bagus

Wirapati. 2016. “Evaluation of PMT-Based Targeting in Indonesia.” Project

Report, World Bank, Washington, DC. Leite, Phillippe. 2014. “Effective Targeting for the Poor and Vulnerable.” Social

Protection & Labor Technical Note No. 6, World Bank, Washington, DC. Leite, Phillippe 2015. “Short- and Long-Term Targeting in Kenya.” In Safety Nets in

Africa: Effective Mechanisms to Reach the Poor and Most Vulnerable, edited by Carlo del Ninno and Bradford Mills. Washington, DC: World Bank. https://doi .org/10.1596/978-1-4648-0435-9. Lindert, Kathy, Tina George Karippacheril, Inés Rodríguez Caillava, and Kenichi

Nishikawa Chávez. 2020. Sourcebook on the Foundations of Social Protection Delivery

Systems. Washington, DC: World Bank. Lubarsky, Boris. 2017. “Re-Identification of ‘Anonymized’ Data.” Georgetown Law,

Technology Review, Washington, DC. https://georgetownlawtechreview.org /re-identification-of-anonymized-data/GLTR-04-2017/. Mao, Huina, Xin Shuai, Yong-Yeol Ahn, and Johan Bollen. 2013. “Mobile

Communications Reveal the Regional Economy in Côte d’Ivoire.” Paper presented at NetMob 2013, Cambridge, MA, May 1–3. Masaki, Takaaki, David Locke Newhouse, Ani Rudra Silwal, Adane Bedada, and

Ryan Engstrom. 2020. “Small Area Estimation of Non-Monetary Poverty with

Geospatial Data.” Policy Research Working Paper 9383, World Bank,

Washington, DC. https://ideas.repec.org/p/wbk/wbrwps/9383.html. McBride, Linden, and Austin Nichols. 2016. “Retooling Poverty Targeting Using

Out-of-Sample Validation and Machine Learning.” World Bank Economic Review 32 (3): 531–50. McCord, Anna. 2013. “Community-Based Targeting in the Social Protection Sector.”

Working Paper No. 514, Overseas Development Institute, London. https:// medium.com/center-for-effective-global-action/using-mobile-phone-and -satellite-data-to-target-emergency-cash-transfers-f0651b2c1f3f. MINALOC (Ministry of Local Government). 2015. “Revised Ubudehe Categories.”

MINALOC, Kigali, Rwanda. www.minaloc.gov.rw. MISSOC (Mutual Information System on Social Protection). 2020. “Comparative

Tables.” MISSOC, European Commission, Brussels, Belgium. https://www .missoc.org/missoc-database/comparative-tables/. MoARD (Ministry of Agriculture and Rural Development). 2006. “Productive

Safety Net Programme, Programme Implementation Manual.” MoARD, Addis

Ababa, Ethiopia. Moffitt, Robert A. (ed.). 2015. Economics of Means-Tested Transfer Programs in the United

States. Cambridge, MA: National Bureau of Economic Research. https://www .nber.org/books-and-chapters/economics-means-tested-transfer-programs -united-states-volume-1. Molina, Isabel, Paul Corral, and Minh Nguyen. 2021. “Model-Based Methods for

Poverty Mapping: A Review.” Luxembourg Institute of Socio-Economic

Research, Esch-sur-Alzette, Luxembourg.

462 | Revisiting Targeting in Social Assistance

Molina, Isabel, and J. N. K. Rao. 2010. “Small Area Estimation of Poverty Indicators.”

Canadian Journal of Statistics / La Revue Canadienne De Statistique 38 (3): 369–85 (accessed June 15, 2021). http://www.jstor.org/stable/27896031. Nizeyimana, Pacifique, Kee-Won Lee, and Songyong Sim. 2018. “A Study on the

Classification of Households in Rwanda Based on Factor Scores.” Journal of the

Korean Data & Information Science Society 29 (2): 547–55. Njuguna, Christopher, and Patrick McSharry. 2017. “Constructing Spatiotemporal

Poverty Indices from Big Data.” Journal of Business Research 70: 318–27. Noriega-Campero, Alejandro, Bernardo Garcia-Bulle, Luis Fernando Cantu, Michiel

A. Bakker, Luis Tejerina, and Alex Pentland. 2020. “Algorithmic Targeting of

Social Policies: Fairness, Accuracy, and Distributed Governance.” Conference on Fairness, Accountability, and Transparency (FAT* ’20), January 27–30,

Barcelona, Spain. ACM, New York. https://doi.org/10.1145/3351095.3375784. OECD (Organisation for Economic Co-operation and Development). 2013. Greece:

Reform of Social Welfare Programs. OECD Public Governance Reviews. Paris: OECD. OECD (Organisation for Economic Co-operation and Development). 2018. Social

Protection System Review of Kyrgyzstan. OECD Development Pathways. Paris:

OECD Publishing. OECD (Organisation for Economic Co-operation and Development). 2019.

“Enhancing Access to and Sharing of Data: Reconciling Risks and Benefits for

Data Re-Use across Societies.” Paris: OECD Publishing. https://doi .org/10.1787/276aaca8-en. Ohlenburg, Tim. 2020a. “AI in Social Protection: Exploring Opportunities and

Mitigating Risks.” GIZ, Bonn. Ohlenburg, Tim. 2020b. “Technical Report: Machine Learning for Proxy Means

Testing in Indonesia.” World Bank, Washington, DC. Ortakaya, Ahmet Fatih. 2020. “COVID-19 Social Support Program in Turkey.”

World Bank, Washington, DC. Ortakaya, Ahmet Faith. 2021. “BMM Framework in Turkey’s Integrated Social

Assistance System (ISAS).” Presentation at the SPJ Core Courses, May 15–18.

Kuwait. Paes de Barros, Ricardo, Diana Coutinho, Samuel Franco, and Rosane Mendonça. 2016. “Desenho de um Sistema para Aferição dos Valores dos Beneficions do

Programa Renda Melhor.” Secretaria de Estado de Assistência Social e Direitos

Humanos – SEASDH Governo do Estado do Rio de Janeiro. Pokhriyal, Neeti, and Damien Christophe Jacques. 2017. “Combining Disparate

Data Sources for Improved Poverty Prediction and Mapping.” PNAS 114 (46):

E9783–E9792. Pople, Ashley, Ruth Hill, Stefan Dercon, and Ben Brunckhorst. 2021. “Anticipatory

Cash Transfers in Climate Disaster Response.” Working Paper 6, Centre for

Disaster Protection, London. Premand, Patrick, and Pascale Schnitzer. 2018. “Efficiency, Legitimacy and Impacts of Targeting Methods: Evidence from an Experiment in Niger.” Policy Research

Working Paper 8412, World Bank, Washington, DC. Roberts, Mark, Frederico Gil Sander, and Sailesh Tiwari. 2019. Time to ACT: Realizing

Indonesia’s Urban Potential. Washington, DC: World Bank. https://doi.org /10.1596/978-1-4648-1389-4.

How to Harness the Power of Data and Inference | 463

Robertson, Laura, Phyllis Mushati, Jeffrey W. Eaton, Lovemore Dumba, et. al. 2013.

“Effects of Unconditional and Conditional Cash Transfers on Child Health and

Development in Zimbabwe: A Cluster-Randomised Trial.” Lancet 381 (9874): 1283–92. https://doi.org/10.1016/S0140-6736(12)62168-0. Rosenbaum, Dorothy. 2019. “SNAP’s ‘Broad-Based Categorical Eligibility’ Supports

Working Families and Those Saving for the Future.” Center on Budget and

Policy Priorities, Washington, DC. Schmid, Timo, Fabian Bruckschen, Nicola Salvati, and Till Zbiranski. 2017.

“Constructing Sociodemographic Indicators for National Statistical Institutes by

Using Mobile Phone Data: Estimating Literacy Rates in Senegal.” Journal of the

Royal Statistical Society: Series A (Statistics in Society) 180 (4): 1163–90. Schnitzer, Pascale. 2019. “How to Target Households in Adaptive Social Protection

Systems? Evidence from Humanitarian and Development Approaches in

Niger.” Journal of Development Studies 55 (sup1): 75–90. Scott Morton, Fiona, and David Dinielli. 2020. “Roadmap for a Digital Advertising

Monopolization Case against Google.” Omidyar Network. https://omidyar .com/roadmap-for-a-monopolization-case-against-google-regarding-the -search-market/. Sepulveda Carmona, Magdalena. 2018. “Is Biometric Technology in Social Protection

Programmes Illegal or Arbitrary? An Analysis of Privacy and Data Protection.”

Extension of Social Security Working Paper 59, International Labour

Organization, Geneva. https://www.researchgate.net/publication/325909014_Is _biometric_technology_in_social_protection_programmes_illegal_or_arbitrary_An _analysis_of_privacy_and_data_protection. Sepulveda Carmona, Magdalena, and Carly Nyst. 2012. “The Human Rights

Approach to Social Protection.” Ministry of Foreign Affairs, Helsinki, Finland. https://ssrn.com/abstract=2114384. Shmueli, Galit. 2010. “To Explain or to Predict?” Statistical Science 25 (3): 289–310. https://doi.org/10.1214/10-STS330. Shrestha, Mahesh. 2020. “Improving the Integrated Household Database

System for More Effective Social Assistance in Mongolia.” World Bank,

Washington, DC. Silva-Leander, Sebastian, and Fred Merttens. 2016. “HSNP: Assessment of

Programme Targeting.” Oxford Policy Management, Oxford, UK. https://www .opml.co.uk/files/Publications/a0013-evaluation-kenya-hunger-safety-net -programme/assessment-of-hsnp2-targeting.pdf?noredirect=1. Skoufias, Emmanuel, and Javier Báez. 2021. “Operationalizing Vulnerability to

Poverty.” Working Paper, World Bank, Washington, DC. Skoufias, Emannuel, Yasuhiro Kawasoe, Eric Strobl, and Pablo Acosta. 2019a.

“Identifying the Vulnerable to Poverty from Natural Disasters: The Case of

Typhoons in the Philippines.” Policy Research Working Paper 8857, World

Bank, Washington, DC. Skoufias, Emannuel, Katja Vinha, Alvina Erman, and Stephane Hallegatte. 2019b.

“Identifying the Vulnerable to Poverty in Africa.” World Bank, Washington, DC. Smith IV, Jack. 2016. “Crime-Prediction Tool May Be Reinforcing Discriminatory

Policing.” Business Insider, October 10. https://www.businessinsider.com /predictive-policing-discriminatory-police-crime-2016-10?r=UK.

464 | Revisiting Targeting in Social Assistance

Smith-Clarke, Christopher, Afra Mashhadi, and Licia Capra. 2014. “Poverty on the

Cheap: Estimating Poverty Maps Using Aggregated Mobile Communication

Networks.” In Proceedings of the SIGCHI Conference on Human Factors in Computing

Systems, 511–20. CHI 2014, New York: ACM. Steele, Jessica E., Pål Roe Sundsøy, Carla Pezzulo, Victor A. Alegana, Tomas J. Bird,

Joshua Blumenstock, Johannes Bjelland, Kenth Engø-Monsen, Yves-

Alexandre de Montjoye, Asif M. Iqbal, Khandakar N. Hadiuzzaman, Xin Lu,

Erik Wetter, Andrew J. Tatem, and Linus Bengtsson. 2017. “Mapping Poverty

Using Mobile Phone and Satellite Data.” Journal of the Royal Society Interface 14 (127): 20160690. Stock, James H., and Mark W. Watson. 2003. “Forecasting Output and Inflation:

The Role of Asset Prices.” Journal of Economic Literature XLI: 788–829. Stone, M. 1974. “Cross-Validatory Choice and Assessment of Statistical Predictions (with Discussion).” Journal of the Royal Statistical Society Ser. B 39: 111–47. http:// www.jstor.org/stable/2984809. Tatman, Rachael. 2017. “Gender and Dialect Bias in YouTube’s Automatic Captions.”

Proceedings of the First Workshop on Ethics in Natural Language Processing, 53–59,

Valencia, Spain, April 4. Tesliuc, Emil, Phillippe Leite, and Katerina Petrina. 2009. “Improving Targeting of

Social Assistance Programs in the Ukraine.” World Bank, Washington, DC. Tesliuc, Emil, Lucian Pop, Margaret Grosh, and Ruslan Yemtsov. 2014. Income

Support for the Poorest: A Review of the Experience in Eastern Europe and Central Asia.

Directions in Development Human Development. Washington, DC: World

Bank. https://openknowledge.worldbank.org/handle/10986/18886. Toole, Jameson L., Yu-Ru Lin, Erich Muehlegger, Daniel Shoag, Marta C. González, and David Lazer. 2015. “Tracking Employment Shocks Using Mobile Phone

Data.” Journal of the Royal Society Interface 12 (107): 20150185. Turkey MFSP and World Bank. 2016. “Turkey’s Integrated Social Assistance

System.” World Bank, Washington, DC. Van Domelen, Julie, and Sarah Coll-Black. 2012. Ethiopia: Designing and Implementing a

Rural Safety Net in a Low Income Setting: Lessons Learned from Ethiopia’s Productive Safety

Net Program 2005–2009. Washington, DC: World Bank Group. http://documents .worldbank.org/curated/en/247601469672211732/Ethiopia-Designing -and-implementing-a-rur. Ward, Patrick, Alex Hurrell, Aly Visram, Nils Riemenschneider, Luca Pellerano,

Clare O’Brien, Ian MacAuslan, and Jack Willis. 2010. “Cash Transfer Programme for Orphans and Vulnerable Children (CT-OVC), Kenya.” Oxford Policy

Management, Oxford, UK. Waze. 2018, 2020. “Driving Directions, Traffic Reports & Carpool Rideshares by

Waze.” 2018, 2020. https://www.waze.com/ccp. Waze. 2018. “Waze Celebrates 600 Connected Citizens Program Partners.” Blog,

August 9. https://medium.com/waze/waze-celebrates-600-connected -citizensprogram-partners-36945fbceb66. Wesolowski, Amy, Nathan Eagle, Andrew J. Tatem, David L. Smith, Abdisalan M.

Noor, Robert W. Snow, and Caroline O. Buckee. 2012. “Quantifying the Impact of Human Mobility on Malaria.” Science 338 (6104): 267–70. https://doi .org/10.1126/science.1223467.

How to Harness the Power of Data and Inference | 465

World Bank. 2015. The Impact of Targeted Social Assistance on Labor Markets in Georgia:

A Regression Discontinuity Approach. Washington, DC: World Bank. https:// openknowledge.worldbank.org/handle/10986/22502. World Bank. 2019a. “Kosovo Social Assistance Scheme Study: Assessment and

Reform Options.” Report No. AUS0000628, World Bank, Washington, DC. World Bank. 2019b. “A Quantitative Evaluation of the Greek Social Solidarity

Income.” World Bank, Washington, DC. World Bank. 2020. “Strengthen Ethiopia’s Adaptive Safety Net Project.” PAD 3737,

World Bank, Washington, DC. World Bank. 2021a. “Social Assistance Programs in China: Current State and

Directions for Reform.” Technical Note P171959, Social Protection and Labor

Markets Advisory Services and Analytics Programmatic ASA, World Bank,

Washington, DC. World Bank. 2021b. World Development Report 2021: Data for Better Lives. Washington,

DC: World Bank. https://www.worldbank.org/en/results/2021/04/13/prioritizing -the-poorest-and-most-vulnerable-in-west-africa-togo-s-novissi-platform-for -social-protection-uses-machine-l. World Bank and UNICEF (World Bank and United Nations Children’s Fund). 2020.

“Core Diagnostics of the Social Protection System in Armenia.” World Bank,

Washington, DC. https://www.unicef.org/armenia/media/9286/file/Core%20

Diagnostic%20of%20the%20Social%20Protection%20System%20in%20

Armenia.pdf. Zeller, Manfred, Joseph Feulefack, and Andreas Neef. 2006. “How Accurate Is

Participatory Wealth Ranking (PWR) in Targeting the Poor? A Case Study from

Bangladesh.” International Association of Agricultural Economists Annual

Meeting, August 12–18, Queensland, Australia. Zhang, Yuan, Qingjun Chen, and Sheng Zhong. 2016. “Privacy-Preserving Data

Aggregation in Mobile Phone Sensing.” IEEE Transactions on Information Forensics and Security 11 (5): 980–92. https://doi.org/10.1109/TIFS.2016.2515513. Zou, James, and Londa Schiebinger. 2018. “AI Can Be Sexist and Racist—It’s Time to Make It Fair.” Nature 559: 324–26 (accessed September 15, 2019), https:// www.nature.com/articles/d41586-018-05707-8.