[Remote] Senior AI Engineer (NVIDIA NIM & Triton)
Note: The job is a remote job and is open to candidates in USA. Dice is seeking a Senior AI Engineer with strong experience in NVIDIA AI technologies, specifically NVIDIA NIM Microservices and Triton Inference Server. The ideal candidate will be responsible for designing, deploying, optimizing, and scaling Generative AI and LLM-based applications in enterprise environments.ResponsibilitiesDesign and deploy AI applications using NVIDIA NIM MicroservicesBuild and optimize model serving infrastructure using Triton Inference ServerDeploy and manage LLM workloads in Kubernetes environmentsOptimize inference performance using TensorRT-LLM and CUDACollaborate with Data Science, MLOps, and Platform Engineering teamsImplement scalable, secure, and production-ready AI solutionsTroubleshoot and improve AI application performance and reliabilitySupport cloud-based AI deployments across AWS, Azure, or Google Cloud PlatformSkillsHands-on experience with NVIDIA NIM MicroservicesStrong experience with NVIDIA Triton Inference ServerExperience deploying and serving Large Language Models (LLMs)Knowledge of TensorRT-LLM and CUDA optimizationExperience with Kubernetes and Docker containerizationStrong Python programming skillsExperience building AI/ML applications in AWS, Azure, or Google Cloud PlatformUnderstanding of model inference, model serving, and performance tuningExperience with REST APIs and microservices architectureExperience with NVIDIA NeMoExperience with RAG (Retrieval-Augmented Generation) architecturesFamiliarity with LangChain or LlamaIndexExposure to MLOps/LLMOps practicesExperience with monitoring and observability toolsCompany OverviewDice is the go-to career marketplace for tech professionals. It was founded in 2010, and is headquartered in Drachten, Friesland, NLD, with a workforce of 201-500 employees. Its website is https://www.or-quest.nl/.Company H1B SponsorshipDice has a track record of offering H1B sponsorships, with 2 in 2022, 4 in 2021, 5 in 2020. Please note that this does not guarantee sponsorship for this specific role.