Note: The job is a remote job and is open to candidates in USA. Dynatrace is a leader in unified observability and security. They are seeking a Principal Generative AI Engineer to design and ship production-grade agentic AI systems that connect development workflows with production observability, helping engineers understand code and assess the impact of changes before they hit production.
Responsibilities
- Design, build, and ship agentic AI systems and tooling that helps engineers understand code, assess the impact of changes before they hit production, and act on real runtime signals
- Build production LLM systems end to end, managing prompting, tool calling, retrieval, memory management, and the agent loops that tie them together
- Define the evaluation strategies, metrics, and datasets that make agent quality measurable, ensuring we ship on evidence and catch regressions across model and prompt changes
- Connect development workflows with production observability, turning code context and runtime signals into reliable, actionable insight, and collaborate with product, design, and platform teams to identify developer problems
- Set technical strategy and architectural direction for the team's AI systems, mentor engineers across the organization, and take full ownership of systems using Dynatrace to monitor and optimize them
Skills
- Degree in Software Engineering or equivalent practical experience in software development, combined with a track record of technical leadership and the judgment to set direction in an ambiguous, fast-moving space
- Extensive experience shipping production systems that use LLMs, including prompting, tool calling, evaluation, and iteration
- A strong foundation in at least one of: developer tooling (IDEs, compilers, static analysis, code intelligence), AI/ML engineering, or large-scale distributed systems
- Hands-on experience with agentic patterns, specifically planning, tool use, retrieval, and memory management
- The ability to evaluate and critique AI-generated output, understanding why a model is wrong, not just that it is, with familiarity with observability and the Dynatrace platform as a strong advantage
Benefits
- Unlimited personal time off
- An employee stock purchase plan
- A reward system
- Medical/dental benefits
- A company-matched 401(k) plan for retirement
Company Overview
Dynatrace delivers answers and intelligent automation from data. It was founded in 2005, and is headquartered in Waltham, Massachusetts, USA, with a workforce of 5001-10000 employees. Its website is https://www.dynatrace.com.Company H1B Sponsorship
Dynatrace has a track record of offering H1B sponsorships, with 1 in 2026, 14 in 2025, 25 in 2024, 15 in 2023, 23 in 2022, 23 in 2021, 8 in 2020. Please note that this does not guarantee sponsorship for this specific role.