Evaluation Specialist (Data Science), P-3
The mission of the UNICEF evaluation function is to help drive results for children by fostering evidence- informed decision-making. Evaluation in UNICEF supports both learning and decision-making, which in turn support better results for children. The evaluation function conducts a diverse set of independent, credible, and impartial corporate thematic, institutional effectiveness, humanitarian, country-led, impact and joint evaluations to ensure UNICEF uses evaluation evidence to improve outcomes for children.
Evaluation at UNICEF is a largely decentralized function with senior-level regional evaluation advisers and multi-country evaluation specialists based in the seven UNICEF regional offices, as well as dedicated country evaluation specialists and evaluation focal points in the UNICEF country offices around the world. The UNICEF Evaluation Office serves as the steward of the UNICEF evaluation function and is located at the New York headquarters. The director of evaluation provides strategic leadership to the global evaluation function at all three levels of the organization.
In the recent years the Evaluation Office (EO) has accelerated its efforts to strengthen the rigor of evaluative evidence and cost-efficiency of its processes. It aims to diversify methods and boost the technical capacity of its staff. Data and AI plays a key role in this forward-looking agenda. Effective use of various types of data and advancement of data science applications in UNICEF evaluations not only can help to plan, track and report results for children more cost-efficiently, but also shape those results with better insights about what is working, what is not, which children are thriving, and which are being left behind.
To this end, the EO is seeking an evaluation specialist (data science) to work on AI and machine learning applications in evaluation. The Evaluation Office values highly motivated candidates who strive to excel and stay abreast of the latest evaluative knowledge and methodological innovations.
How can you make a difference?
Under the supervision of the senior evaluation specialist (head of impact evaluation and methods) the Evaluation specialist (data science) will provide support to organizational efforts in better utilization of AI/machine learning applications in evaluations to improve cost-efficiency of evaluation process and methods. Working collaboratively with the evaluation team in Evaluation office (NYHQ), the incumbent will support evidence generation and use in planned and ongoing global evaluations and impact evaluations, lead replication of tested and effective AI approaches across regions and country office teams.
In accordance with the UNICEF mission, guiding principles, standards, commitments, and accountability framework, and under the revised United Nations Evaluation Group norms and standards, the evaluation specialist (data science) will ensure that all products and applications conducted under her/his technical support and supervision are of the highest possible technical quality, relevance, timeliness, credibility, and utility.
Key functional responsibilities:
1. AI/Machine learning powered project development.
- Lead the experimentation, development and replication of AI/machine learning applications for a wide-range of evaluation purposes. Leverage these means for supporting and enhancing cost-effectiveness, rigorour, and credibility of UNICEF evaluations particularly those conducted in complex environments.
- Identify through consultation with global thematic evaluation teams, evaluation and academic partners other opportunities to create AI platforms with application of big data methods and emerging AI functionalities including but not limited to data mining, predictive analytics, deep machine learning for evaluative purposes such as scoping, evidence synthesis, counterfactual analysis among others.
- Use of Natural Language Processing (NLP) to analyze textual data from the Evaluation Information System Integration (EISI) database – internal database of UNICEF evaluation reports.
- Supervise and mentor consultants and EO interns in all aspects of data science and testing machine learning approaches. Collaborate with the regional and country office teams in joint data/innovation initiatives and pilots.
2. Data Analytics.
- Contribute to a wide range of advanced data analysis for complex rigorous evaluations and collaborate with global evaluation teams to scope, assess and identify relevant data sets to be used for evaluations.
- Advise and guide the EO evaluation staff on using multifaced analytical approaches, including traditional statistical models, machine learning, etc., for the analysis and interpretation of data from different data sources, including surveys, big data, secondary data, etc.
- Lead data innovation in quantitative analysis protocols, including data gathering tools and methodologies collaborating with EO staff across thematic areas and topics.
- Initiate and coordinate pilot studies and applications for using real-time data sources such as mobile technology as well as online media, social networks, remote imagery, geospatial data, administrative and institutional databases.
- Contribute to data management, overseeing medium to large structured and unstructured datasets while maintaining data quality, security, and compliance.
3. Data Visualization and Learning
- Lead and promote creative data visualization on digital and non-digital platforms in a variety of formats.
- Produce concise and high-quality methodological briefs, guidance and learning materials related to AI applications and other technical materials.
4. Capacity development and partnership.
- Support the development and roll-out of capacity-building activities that raise awareness and promote the use of AI/machine learning and rigorous data analytics in UNICEF evaluation.
- Initiate and leverage internal and external partnerships, including with other UNICEF divisions, multilateral and bilateral organizations, other United Nations agencies and academic institutions to advance an effective use of AI/machine learning application across all levels of the UNICEF evaluation function.
Full details available on the UNICEF website. Application deadline 13 December.
