[Remote] Senior Software Engineer, AI and DL Kernel Libraries
Note: The job is a remote job and is open to candidates in USA. NVIDIA is a leading technology company specializing in AI and deep learning solutions. They are seeking a Senior Software Engineer to develop innovative AI systems technologies, focusing on optimizing kernels for high-impact AI workloads and collaborating across teams to enhance NVIDIA's hardware architecture.ResponsibilitiesInnovating and developing new AI systems technologies for efficient inferenceDesigning, implementing, and optimizing kernels for high impact AI workloadsDesigning and implementing extensible abstractions for LLM serving enginesBuilding efficient just-in-time domain specific compilers and runtimesCollaborating closely with other engineers at NVIDIA across deep learning frameworks, libraries, kernels, and GPU arch teamsContributing to open source communities like FlashInfer, vLLM, and SGLangSkillsMasters degree in Computer Science, Electrical Engineering, or related field (or equivalent experience); PhD are preferred6+ years (academic/ industry) experience with ML/DL systems development preferableStrong experience in developing or using deep learning frameworks (e.g. PyTorch, JAX, TensorFlow, ONNX, etc) and ideally inference engines and runtimes such as vLLM, SGLang, and MLCStrong Python and C/C++ programming skillsStrong experience in GPU kernel development and performance optimizations (especially using CUDA C/C++, cuTile, Triton, or similar)Background in domain specific compiler and library solutions for LLM inference and training (e.g. FlashInfer, Flash Attention)Expertise in inference engines like vLLM and SGLangExpertise in machine learning compilers (e.g. Apache TVM, MLIR)Open source project ownership or contributionsBenefitsEquityBenefitsCompany OverviewNVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI. It was founded in 1993, and is headquartered in Santa Clara, California, USA, with a workforce of 10001+ employees. Its website is https://www.nvidia.com.Company H1B SponsorshipNVIDIA has a track record of offering H1B sponsorships, with 448 in 2026, 1872 in 2025, 1354 in 2024, 976 in 2023, 835 in 2022, 601 in 2021, 529 in 2020. Please note that this does not guarantee sponsorship for this specific role.