Senior AI Evaluation Engineer (CICD & Platform)

Your work days are brighter here.

The Forward Intelligence team owns the skills that power Workday's deployment agent—turning the deep configuration expertise and hard-earned wisdom of our Domain Experts and Deployment Consultants into production-grade, fully tested skills that the agent can execute lawfully in live customer tenants.

What we own: The end-to-end skill engine and governance ecosystem, spanning skill knowledge extraction, promotion pipelines, evaluation frameworks, self-correcting drift detection, and developer authoring environments.

How we build: Automated testing harnesses and release-gating pipelines running at enterprise scale, ensuring deterministic execution, strict schema compliance, and zero regressions for skills executing in live customer tenants.

Agentic engineering: We build evaluation tooling, synthetic datasets, and automated red-teaming pipelines that help engineers test how AI agents and Model Context Protocol (MCP) skills perform across complex tenant environments.

How we work: Close end-to-end collaboration across domain experts, AI platform engineers, and site reliability teams to transform domain knowledge into trustworthy, production-ready AI skills. About the Role

We are seeking a Senior AI Evaluation Engineer (CI/CD & Platform) to own the continuous evaluation architecture, deployment pipeline infrastructure, and release gating for our enterprise AI Skills platform. In this role, you will build both the MLOps/CI-CD deployment pipelines and the automated eval harnesses that ensure all production AI skills execute accurately, remain schema-compliant, and run safely in live customer environments.

You will bridge the gap between AI skill development and production platform engineering—leveraging modern evaluation frameworks (e.g., LangSmith, Braintrust, DeepEval) alongside CI/CD pipelines to evaluate agent trajectories, test schema contracts, and certify every skill before deployment.

Key Responsibilities

…