Director, AI Systems Engineering & Evaluation
novartis · Dublin (NOCC)
Job description
About the role
This is a senior AI leader role within Novartis Global Drug Development (GDD), based in Dublin on a hybrid basis. The Director designs, builds and productionises the shared foundations on which every Development AI system runs, including reusable agentic architectures, agent-accessible tools and knowledge, evaluation harnesses, physical AI patterns and AgentOps pipelines. The position works closely with DSAI domain leaders, Product teams, Strategy & Governance and DDIT.
Key responsibilities
- Develop a roadmap for shared AI foundations, including agentic architectures, retrieval and knowledge systems, simulation and digital twins.
- Architect and productionise reusable agentic components such as orchestration, memory and context management, tool integration and human-in-the-loop patterns, as templates and reference implementations.
- Define agent and model evaluation frameworks covering reliability, hallucination risk, grounding, task completion and regulatory-grade auditability, and build benchmark suites, datasets and test harnesses.
- Establish red teaming and adversarial testing (prompt injection, jailbreaks, retrieval attacks, tool misuse) with cybersecurity.
- Set production-readiness criteria and monitoring, including drift, degradation and failure-mode analysis, and support validation of GxP-relevant systems.
- Define MLOps, LLMOps and AgentOps practices (versioning, orchestration, tracing, observability) and work with DDIT to embed the required signals in platforms.
- Build the data and knowledge foundations that agentic systems depend on, integrating internal and external data sources, APIs and knowledge bases with access controls and governance.
- Link technical performance evidence to business-value KPIs, and turn project-level solutions into reusable capabilities.
- Coordinate resources across initiatives, manage risks and stakeholder expectations, and guide technology selection.
- Publish and present at conferences, coach data scientists and AI engineers, and act as a Novartis ambassador for applied and agentic AI.
Required profile
- 10+ years in Data Science or AI, with experience building and deploying production AI/ML systems.
- Hands-on experience with agentic frameworks and turning prototypes into reusable, production-grade capabilities.
- Proven experience defining evaluation approaches, benchmarks and production-readiness criteria for LLM or agentic systems.
- Experience leading senior technical teams and external partners in complex, regulated environments; healthcare or life sciences experience preferred.
Required skills
- Agentic frameworks such as LangGraph, AutoGen, CrewAI or equivalent.
- Evaluation of LLMs and agentic systems, red teaming and responsible AI practices.
- MLOps, LLMOps and AgentOps concepts.
What we offer
- Annual base salary range in Ireland of 102,200 to 189,800 EUR.
- Possible performance-based bonus.
- Flexible and hybrid working options where possible.
- Insurance plans, retirement plans, wellbeing resources and global recognition programs.
- Minimum of 14 weeks paid parental leave.
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in Ireland.
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 7 hours ago
Expires 1 month from now
6 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
novartis
Dublin (NOCC)
Related job offers
-
Associate Director, Applied AI (FDE)
novartis Dublin (NOCC) -
Associate Director & Senior Principal Data Science, AI for Biologics
novartis Dublin (NOCC) -
Design Engineer II - High-Speed Ethernet Controller IP
cadence CORK 01 -
Product Manager - Commercial Card, Vision Next
fiserv Dublin -
Director of Product, Vision Next
fiserv Dublin