[Remote] Senior AI Platform Engineer, Core Cloud Engineering

Note: The job is a remote job and is open to candidates in USA. Vultr is on a mission to make high-performance cloud infrastructure easy to use and affordable. They are seeking a highly skilled AI Platform Engineer to embed AI into the workflows of their software engineering organization and transform how Vultr builds.ResponsibilitiesEvaluate and curate open-source models — Llama, Mistral, Qwen, DeepSeek, Kimi, and others — for fit across engineering use cases including code generation, review, test writing, and summarizationBuild and maintain MCP (Model Context Protocol) servers that expose internal context — codebases, runbooks, incident history, architecture docs, development environments, and testing suites — to AI assistants and coding agentsIntegrate AI capabilities directly into GitLab CI/CD pipelines: automated code review, test generation, changelog drafting, PR summarization, and anomaly detection in build outputOwn the model lifecycle: versioning, A/B routing, quantization tradeoffs, and performance benchmarking under real engineering workloadsDrive AI adoption across the software engineering organization — identify high-leverage workflows, instrument usage, and iterate based on real data on time-savings and quality impactBuild and configure IDE tooling integrations — Cursor, Continue, and Copilot alternatives — backed by internal inference endpoints, keeping code off third-party APIs wherever possibleProduce documentation, internal workshops, and working examples that help engineers go from AI-curious to AI-reliant — including a shared library of prompts, system instructions, and RAG pipelines tuned for Vultr’s stackCollaborate closely with Software Engineers, SREs, and Network Engineers to ensure the AI platform layer serves all teams without becoming a bottleneck or single point of failureSkillsHands-on experience deploying and operating LLM inference systems — vLLM, SGLang, TGI, or comparable — at non-trivial scaleStrong Docker and container skills; comfortable owning the full container lifecycle from image build to productionDeep familiarity with GitLab CI/CD — pipeline authoring, custom runners, artifact management, and integrating external toolingWorking knowledge of MCP or similar context-injection patterns for grounding LLMs against private or internal dataDemonstrated ability to evaluate open-source models for specific task fit — not just benchmarks, but real use-case performance against internal workloadsStrong software engineering fundamentals — this role writes real code, not just configurationExperience with RAG pipelines — vector databases, chunking strategies, retrieval evaluation — especially over code or technical documentationGPU infrastructure familiarity — CUDA basics, multi-GPU serving, memory management under inference loadAbility to communicate technical tradeoffs clearly to engineers, managers, and leadership; track record of moving organizations toward new practicesBenefits100% company-paid insurance premiums for employee medical, dental and vision plans.401(k) plan that matches 100% up to 4%, with immediate vestingProfessional Development Reimbursement of $2,500 each year11 Holidays + Paid Time Off Accrual + Rollover PlanCommitment matters to Vultr! Increased PTO at 3 year and 10 year anniversary + 1 month paid sabbatical every 5 years + Anniversary Bonus each year$500 stipend for remote office setup in first year + $400 each following yearInternet reimbursement up to $75 per monthGym membership reimbursement up to $50 per monthCompany paid Wellable subscriptionCompany OverviewVultr is an AI cloud infrastructure platform offering latest generation NVIDIA GPUs and AMD CPUs and GPUs across 32 worldwide regions It was founded in 2014, and is headquartered in West Palm Beach, Florida, USA, with a workforce of 201-500 employees. Its website is https://www.vultr.com.Company H1B SponsorshipVultr has a track record of offering H1B sponsorships, with 1 in 2024. Please note that this does not guarantee sponsorship for this specific role.