5. Evaluation process The ADR process will follow the ADR Guidelines, according to which the process can be divided in three phases, each including several steps. Phase 1: Preparation
Desk review: Initially carried out by the Evaluation Office (identification, collection and mapping of relevant documentation and other data) and continued by the evaluation team. This will include general development-related documentation related to China as well as a comprehensive overview of the UNDP programme over the period being examined. Stakeholder mapping: A basic mapping of stakeholders relevant to the evaluation in the country will be carried out. These will include state and civil society stakeholders and go beyond UNDP partners. The mapping exercise will also indicate the relationships between different sets of stakeholders. Inception meetings: Interviews and discussions in UNDP Headquarters with the Evaluation Office (process and methodology), Regional Bureau for Asia and the Pacific (context and county programme), as well as with other relevant bureaux, including the Bureau for Development Policy. Scoping mission and initial workshop: A mission to China will be carried out early in the process by the international team leader and Evaluation Office task manager in order to: Identify
and collect further documentation
Assess
the availability of evaluative evidence, including outcome, programme and project evaluations
Validate
the mapping of the country programmes
Get
key stakeholder perspectives on key issues that should be examined
70
Identify the appropriate set of data collection
and analysis methods Address
management and timing issues related to the rest of the evaluation process
Ensure
the country office and key stakeholders understand the ADR objectives, methodology and process
Importantly, the scoping mission will work with the identified national institution to provide guidance and to work out a detailed work plan for the evaluation. An important part of this process will be an entry workshop where the ADR objectives, methods and process will be clarified. During the scoping mission, the universe of projects and programmes to be visited by the evaluators will be identified. Inception report: An inception report will be prepared by the Chinese team leader in consultation with the international team leader and Evaluation Office task manager. The report will include the evaluation design and plan, background to the evaluation, key evaluation questions, detailed methods, information sources, instruments and tools for data collection and analysis, and the format for reporting. Phase 2: Conducting the ADR and drafting the evaluation report
Research and data collection: The research and data collection phase will be carried out by an independent team sub-contracted from a Chinese national institution and will focus on data collection and validation. The evaluation team will visit significant project and field sites as identified during the scoping mission. The research and data collection phase will be supported by the international team leader and Evaluation Office task manager. A midterm workshop will be organized in China to review progress and to resolve any pending issues pertaining to the evaluation. Analysis and reporting: The information collected will be analysed by the national
A nnex I . T erms of reference