[Remote] Senior AI Graph Compiler Engineer

Note: The job is a remote job and is open to candidates in USA. Modular is a company focused on creating advanced machine learning technologies, and they are seeking a Senior AI Graph Compiler Engineer. This role involves extending and developing the graph compiler to enhance performance and usability across various hardware platforms, ensuring a seamless developer experience.ResponsibilitiesDesign and develop compiler optimizations to improve inference efficiency across CPUs, GPUs, and ML accelerators, including kernel fusion, memory planning, and shape optimizationCompile large-scale application workloads onto heterogeneous hardware: map hardware-agnostic graphs of computational operators onto hardware-specific graphs of devices and nodesCollaborate with the kernels, serving, and Mojo compiler teams to implement core technologies that deliver end-to-end performance across a variety of heterogeneous hardware platformsWrite design documents for new features and drive for alignment on designs with cross-functional teamsCollaborate with the customer success team and engage with customers to understand their performance requirements and use casesSkills5+ years of software engineering experienceProficiency in C++Experience working with compilers for machine learning frameworksCreativity and curiosity for solving complex problems, a team-oriented attitude that enables you to work well with othersKnowledge of and experience working with MLIR and LLVMExperience with ML parallel / distributed programming, heterogeneous ML computation, and/or code generationKnowledge of basic ML implementation and modeling techniques and familiarity with ML frameworks like PyTorch, JAX, or TensorFlowBenefitsPremier insurance plansUp to 5% 401k matchingFlexible paid time offStock optionsTeam Building Events. We organize regular team onsites and local meetups in Los Altos, CA as well as different cities. Traveling 2-4 times a year is expected for all roles.Company OverviewModular provides AI infrastructure for deployment, serving, and programming GPUs. It was founded in 2022, and is headquartered in Palo Alto, California, USA, with a workforce of 51-200 employees. Its website is https://www.modular.com.Company H1B SponsorshipModular has a track record of offering H1B sponsorships, with 3 in 2026, 10 in 2025, 6 in 2024, 8 in 2023, 4 in 2022. Please note that this does not guarantee sponsorship for this specific role.