Jobiglo

No results.

Director, AI Systems Engineering & Evaluation

novartis · Dublin (NOCC)

New
Hybrid Senior 102,200 - 189,800 EUR/year 🇬🇧 English
LangGraph AutoGen CrewAI LLMOps MLOps AgentOps Red teaming Data governance

Job description

About the role

This is a senior AI leader role within Novartis Global Drug Development (GDD), based in Dublin on a hybrid basis. The Director designs, builds and productionises the shared foundations on which every Development AI system runs, including reusable agentic architectures, agent-accessible tools and knowledge, evaluation harnesses, physical AI patterns and AgentOps pipelines. The position works closely with DSAI domain leaders, Product teams, Strategy & Governance and DDIT.

Key responsibilities

  • Develop a roadmap for shared AI foundations, including agentic architectures, retrieval and knowledge systems, simulation and digital twins.
  • Architect and productionise reusable agentic components such as orchestration, memory and context management, tool integration and human-in-the-loop patterns, as templates and reference implementations.
  • Define agent and model evaluation frameworks covering reliability, hallucination risk, grounding, task completion and regulatory-grade auditability, and build benchmark suites, datasets and test harnesses.
  • Establish red teaming and adversarial testing (prompt injection, jailbreaks, retrieval attacks, tool misuse) with cybersecurity.
  • Set production-readiness criteria and monitoring, including drift, degradation and failure-mode analysis, and support validation of GxP-relevant systems.
  • Define MLOps, LLMOps and AgentOps practices (versioning, orchestration, tracing, observability) and work with DDIT to embed the required signals in platforms.
  • Build the data and knowledge foundations that agentic systems depend on, integrating internal and external data sources, APIs and knowledge bases with access controls and governance.
  • Link technical performance evidence to business-value KPIs, and turn project-level solutions into reusable capabilities.
  • Coordinate resources across initiatives, manage risks and stakeholder expectations, and guide technology selection.
  • Publish and present at conferences, coach data scientists and AI engineers, and act as a Novartis ambassador for applied and agentic AI.

Required profile

  • 10+ years in Data Science or AI, with experience building and deploying production AI/ML systems.
  • Hands-on experience with agentic frameworks and turning prototypes into reusable, production-grade capabilities.
  • Proven experience defining evaluation approaches, benchmarks and production-readiness criteria for LLM or agentic systems.
  • Experience leading senior technical teams and external partners in complex, regulated environments; healthcare or life sciences experience preferred.

Required skills

  • Agentic frameworks such as LangGraph, AutoGen, CrewAI or equivalent.
  • Evaluation of LLMs and agentic systems, red teaming and responsible AI practices.
  • MLOps, LLMOps and AgentOps concepts.

What we offer

  • Annual base salary range in Ireland of 102,200 to 189,800 EUR.
  • Possible performance-based bonus.
  • Flexible and hybrid working options where possible.
  • Insurance plans, retirement plans, wellbeing resources and global recognition programs.
  • Minimum of 14 weeks paid parental leave.

Questions fréquentes

Le salaire proposé pour ce poste est de 102-190k EUR par an. Le détail figure dans l'annonce.
Cliquez sur "Postuler maintenant" en haut de la page. Vous pouvez importer votre CV en 1 clic — Jobiglo extrait automatiquement vos informations et postule pour vous.
Source : ats:workday

Why are you reporting this job?

Thank you for your report. We will review this job.

Apply in 30 seconds

Enter your email to apply. An account will be created automatically.

Apply now →

By continuing, you accept our terms of use.

Already have an account? Login

A question about this job?

Ask it here: you will get the full job summary by e-mail, right away.

Published 7 hours ago

Expires 1 month from now

6 views · 0 interested

Boost your chances

Upload your CV — we will match you with relevant openings.

Analyzing your CV...

novartis

Dublin (NOCC)