[Remote] Senior AI Graph Compiler Engineer

Note: The job is a remote job and is open to candidates in USA. Modular is on a mission to revolutionize AI infrastructure by rebuilding the AI software stack from the ground up. The Senior AI Graph Compiler Engineer will extend and develop the graph compiler to support advanced features and hardware platforms, improving performance and usability while collaborating with cross-functional teams.

Responsibilities

• Design and develop compiler optimizations to improve inference efficiency across CPUs, GPUs, and ML accelerators, including kernel fusion, memory planning, and shape optimization
• Compile large-scale application workloads onto heterogeneous hardware: map hardware-agnostic graphs of computational operators onto hardware-specific graphs of devices and nodes
• Collaborate with the kernels, serving, and Mojo compiler teams to implement core technologies that deliver end-to-end performance across a variety of heterogeneous hardware platforms
• Write design documents for new features and drive for alignment on designs with cross-functional teams
• Collaborate with the customer success team and engage with customers to understand their performance requirements and use cases

Skills

• 5+ years of software engineering experience
• Proficiency in C++
• Experience working with compilers for machine learning frameworks
• Creativity and curiosity for solving complex problems, a team-oriented attitude that enables you to work well with others
• Knowledge of and experience working with MLIR and LLVM
• Experience with ML parallel / distributed programming, heterogeneous ML computation, and/or code generation
• Knowledge of basic ML implementation and modeling techniques and familiarity with ML frameworks like PyTorch, JAX, or TensorFlow

Benefits

• Premier insurance plans
• Up to 5% 401k matching
• Flexible paid time off
• Stock options
• Annual target bonus
• Equity
• Team Building Events
• Regular team onsites and local meetups in Los Altos, CA as well as different cities
• Traveling 2-4 times a year is expected for all roles

Company Overview

Modular is an AI infrastructure company that develops a unified software stack for deployment, serving, and programming GPUs. It was founded in 2022, and is headquartered in Palo Alto, California, USA, with a workforce of 51-200 employees. Its website is https://www.modular.com.

Company H1B Sponsorship

Modular has a track record of offering H1B sponsorships, with 6 in 2026, 10 in 2025, 6 in 2024, 8 in 2023, 4 in 2022. Please note that this does not guarantee sponsorship for this specific role.