Note: The job is a remote job and is open to candidates in USA. Yahoo is a leading technology company with over 900 million monthly users, currently transforming its operations to become AI-native. The Staff AI Operations Engineer will architect the AI-native operating engine for Yahoo Mail, focusing on scalable workflows and operational intelligence across various departments.
Responsibilities
- Architect and deploy full-stack internal AI products, from secure backend LLM integrations and agentic workflow orchestration to responsive frontend operating interfaces
- Define the foundational engineering patterns, guardrails, and platform architectures for reliability, data permissions, enterprise privacy, and observability across all internal AI systems
- Establish automated LLM evaluation (Evals), output validation frameworks, and human-in-the-loop validation flows to proactively mitigate inaccuracies or hallucinations in operational systems
- Incorporate state-of-the-art developer frameworks—including AWS Bedrock, Vertex AI, and advanced orchestration patterns—to abstract operational workflows into reusable API layers
- Design, deploy, and continuously optimize multi-agent orchestrations and retrieval-augmented generation (RAG) pipelines that ingest contextual product metadata to synthesize real-time business context
- Collaborate horizontally with Product, Engineering, Design, and Executive leadership to map physical organizational processes into autonomous workflows, serving as the technical authority on internal AI capabilities
- Mentor and uplevel adjacent engineering, product, and operational squads on prompt engineering, structured LLM interactions, and automated workflow adoption
- Turn highly ambiguous, fragmented data sources (e.g., Jira trackers, Google Workspace documents, analytics dashboards) into structured, queryable knowledge networks
Skills
- 8+ years of software engineering, product management, technical systems-building, or platform architecture experience with a focus on full-stack application development
- Professional experience designing, implementing, and evaluating LLM-backed applications, multi-agent frameworks, RAG architectures, or automated internal operations systems
- Deep familiarity with production-grade AI development platforms (e.g., AWS Bedrock, Vertex AI) and modern coding assistants (e.g., Cursor, Claude Code) to accelerate software delivery cycles
- Demonstrated experience building custom API integrations with enterprise platforms (such as Jira, Confluence, and Google Workspace) to automate manual processes
- High-agency ownership with a proven track record of delivering architectural strategy and shipping complex, operational platforms in highly ambiguous environments
- Strong proficiency in modern software engineering stacks, including Python, TypeScript, React, Node.js, and relational/non-relational data systems
- Excellent written and verbal communication skills, with experience presenting complex technical architectures directly to senior stakeholders
- Experience deploying and tuning open-source agentic frameworks or managing large-scale internal copilot environments
- Experience in Product Operations, Business Operations, Strategy, or Technical Program Management within high-scale consumer tech organizations
- Strong background in cloud infrastructure, data pipelining (SQL, ETL processes), and secure enterprise access control management
- Commitment to continuous learning, technological experimentation, and optimizing organizational systems through automation
Benefits
- Incentive compensation opportunities in the form of discretionary annual bonus or commissions
- Healthcare
- A great 401k
- Backup childcare
- Education stipends
- Flexible hybrid work options that our employees love
- 11 employee resource groups (ERGs) enhance a culture of belonging with programs, events and fellowship that help educate, support and create a workplace where all feel welcome
Company Overview
Company H1B Sponsorship