E T Consultant 1 – AI Engineer

E T Consultant 1 – AI Engineer

Description

At the World Bank, a member of the World Bank Group (WBG), you’ll join a diverse, global community working across cultures, disciplines, and borders to address the world’s most pressing development challenges. With 1.2 billion young people reaching working age in the decade ahead, the challenge of job creation has never been greater. Through partnerships across 145 countries and more than 182 offices worldwide, we work with governments, private sector, development partners and other stakeholders to invest in people, strengthen markets, and deliver scalable, data-driven solutions that generate more and better jobs and improve lives. For more information, visit https://www.worldbank.org/en/who-we-are/ibrd

Background

INT is undergoing a significant transformation driven by the adoption of artificial intelligence to enhance operational efficiency, knowledge management, and decision-support capabilities across its global operations. As part of this strategic modernization agenda, the organization is seeking to deploy intelligent, autonomous AI agent systems capable of performing complex, multi-step tasks with minimal human intervention.

INT operates on a Microsoft Azure cloud infrastructure (data storage, compute, identity, and AI/ML services) and leverages a Databricks platform for governed data and advanced analytics. AI solutions are expected to integrate cleanly with this stack and to follow established security, data-governance, and Responsible AI practices.
AI agents represent a next-generation paradigm beyond traditional automation, enabling systems to reason, plan, use tools, and execute workflows dynamically. These capabilities are particularly relevant for internal functions such as procurement support, knowledge retrieval, document processing, policy compliance checking, and operational analytics. This engagement will contribute directly to INT’s digital transformation priorities, consistent with ongoing investments in data-driven tools and intelligent systems across the institution.

This Terms of Reference (TOR) outlines the duties and responsibilities, deliverables and qualifications, for an AI Engineer to be engaged by the World Bank’s INT department to design, develop, and deploy AI solutions within the Azure cloud environment. This role reports to the INT Data Lab team lead and works closely with data scientists, data engineers, software engineers, and domain stakeholders. Specific milestones and priorities are agreed with the team lead and reviewed on a regular cadence.

Duties and Responsibilities

AI solutions Development
• Build and improve LLM-enabled features: prompt templates, structured outputs, tool/function calling, and robust logging and error handling.
• Design and implement agentic workflows (planning, tool use, memory, multi-step execution), including orchestrator–subagent patterns where appropriate.
• Build and tune RAG pipelines (ingestion, chunking, metadata, embeddings, retrieval) and run evaluations for accuracy, task completion, latency, and safety.
• Integrate AI solutions with INT's internal systems, APIs, and document repositories to deliver measurable operational value.

AI solutions Deployment and Operations
• Establish CI/CD pipelines for solutions deployment using Azure DevOps.
• Configure monitoring and observability using Azure Monitor, Application Insights, and custom logging to track performance, errors, and usage patterns in production.
• Ensure all deployments comply with World Bank Group IT security policies, data classification requirements, and privacy standards.
• Implement Responsible AI guardrails, including content filtering, output validation, and human-in-the-loop escalation mechanisms where required.
• Apply and help mature reusable patterns and architectural standards for AI development that are scalable, secure, and maintainable.

Documentation & Knowledge Transfer
• Produce comprehensive technical documentation including architecture design documents, API specifications, deployment guides, and operational run-books.
• Develop governance documentation covering model cards, data lineage, risk assessments, and responsible AI checklists.
• Conduct structured knowledge transfer sessions with INT technical teams to ensure sustainability of deployed solutions.
• Prepare user-facing guides and training materials for non-technical stakeholders interacting with AI agent interfaces.

Deliverables
• Deployed AI solutions and prototypes — working prototypes and production-deployed LLM/agent solutions for prioritized use cases, integrated with INT systems on Azure and following team standards.
• Optimized RAG pipelines — efficient indexing, retrieval, and inference, delivered as reusable agent/RAG components (ingestion steps, retrieval configs, tool integrations).
• Prompt performance and evaluation reports — comparative analyses of prompt/model performance, with prompts iterated based on user feedback and metrics (accuracy, task completion, latency, safety).
• CI/CD, monitoring, and resolved integrations — deployment pipelines, monitoring/alerting, and integration issues resolved in collaboration with developers and DevOps.
• Technical documentation, version control, and change logs — architecture/API docs and runbooks, with AI model version control and change logs maintained and kept current.
• Knowledge transfer and training materials — KT sessions for INT technical teams and user-facing guides for non-technical stakeholders.

Selection Criteria

• Education: Bachelor's degree in Computer Science, AI/ML, Data Science, Software Engineering, or a closely related field (preferred: Master's degree or higher in a relevant discipline).
• Minimum 2 years of overall experience as an AI Engineer or in a similar role, with a successful track record of working with AI, ML, and LLMs.
• Within that, a minimum of 2 years of hands-on experience designing and developing AI solutions, with demonstrable experience in LLMs, RAG, and AI systems.
• Hands-on experience with LLM APIs, RAG, vector search, agent frameworks (e.g., LangGraph, AutoGen, Semantic Kernel, CrewAI, LlamaIndex, etc.), tool/function calling, context engineering, and prompt design, plus LLM evaluation and observability (evals, tracing, monitoring).
• Strong in Python (preferred) or other programming languages, and API development (e.g., FastAPI).
• Strong Responsible AI and security awareness (guardrails, data privacy, access control).
• Proven experience building and deploying solutions on cloud (preferred: Azure).
• Fluent, disciplined use of AI coding assistants.
• Strong analytical and problem-solving skills with the ability to translate complex technical concepts for non-technical audiences.
• Demonstrated ability to work independently and manage multiple priorities in a fast-paced environment.
• Collaborative mindset with experience working in cross-functional teams.
• Excellent written and verbal communication skills in English.

Preferred Qualifications
• Microsoft Azure certifications (e.g., Azure AI Engineer Associate — AI-102) are highly desirable.
• Experience taking AI solutions to production (CI/CD, containerization, monitoring).
• Data engineering or science experience (Databricks, vector or Graph databases).
• Experience working in international development, public sector, or multilateral organization contexts.
• Familiarity with World Bank operational policies, IT standards, or similar institutional environments.
• Experience with multi-agent system design and agentic workflow orchestration at scale.

WBG Culture Attributes:

1. Sense of urgency: Anticipate and quickly respond to the needs of internal and external stakeholders.
2. Thoughtful risk-taking: Challenge the status quo and push boundaries to achieve greater impact.
3. Empowerment and accountability: Empower yourself and others to act and hold each other accountable for results.

World Bank Group Core Competencies

As per WBG policy, an Extended Term (ET) appointment is subject to a lifetime maximum of three (3) years. Former and current ET staff who have completed or are in the process of completing their third-year ET appointment are not eligible for future ET appointments.

We are proud to be an equal opportunity and inclusive employer with a dedicated and committed workforce, and do not discriminate based on gender, gender identity, religion, race, ethnicity, sexual orientation, or disability.

Learn more about working at the World Bank and IFC including our values and inspiring stories.