Platform engineer, MLOps

About this role As a Platform engineer, MLOps, you will be critical to deploying and managing cutting-edge infrastructure crucial for AI/ML operations, and you will collaborate with AI/ML engineers and researchers to develop a robust CI/CD pipeline that supports safe and reproducible experiments. Your expertise will also extend to setting up and maintaining monitoring, logging, and alerting systems to oversee extensive training runs and client-facing APIs. You will ensure that training environments are optimally available and efficiently managed across multiple clusters, enhancing our containerization and orchestration systems with advanced tools like Docker and Kubernetes. This role demands a proactive approach to maintaining large Kubernetes clusters, optimizing system performance, and providing operational support for our suite of software solutions. If you are driven by challenges and motivated by the continuous pursuit of innovation, this role offers the opportunity to make a significant impact in a dynamic, fast-paced environment. ‍♀️ Your responsibilities:Work closely with AI/ML engineers and researchers to design and deploy a CI/CD pipeline that ensures safe and reproducible experiments.Set up and manage monitoring, logging, and alerting systems for extensive training runs and client-facing APIs.Ensure training environments are consistently available and prepared across multiple clusters.Develop and manage containerization and orchestration systems utilizing tools such as Docker and Kubernetes.Operate and oversee large Kubernetes clusters with GPU workloads.Improve reliability, quality, and time-to-market of our suite of software solutionsMeasure and optimize system performance, with an eye toward pushing our capabilities forward, getting ahead of customer needs, and innovating for continual improvementProvide primary operational support and engineering for multiple large-scale distributed software applications⭐️ Is this you? You have professional experience with: Model trainingHuggingface TransformersPytorchvLLMTensorRTInfrastructure as code tools like TerraformScripting languages such as Python or BashCloud platforms such as Google Cloud, AWS or AzureGit and GitHub workflowsTracing and MonitoringFamiliar with high-performance, large-scale ML systemsYou have a knack for troubleshooting complex systems and enjoy solving challenging problemsProactive in identifying problems, performance bottlenecks, and areas for improvementTake pride in building and operating scalable, reliable, secure systemsFamiliar with monitoring tools such as Prometheus, Grafana, or similarAre comfortable with ambiguity and rapid changePreferred skills and experience: Familiar with monitoring tools such as Prometheus, Grafana, or similar5+ years building core infrastructure Experience running inference clusters at scaleExperience operating orchestration systems such as Kubernetes at scale#LI-Remote Benefits & perks (US Full-time employees)Generous PTO, plus company holidaysMedical, dental, and vision coverage for you and your familyPaid parental leave for all parents (12 weeks)Fertility and family planning supportEarly-detection cancer testing through GalleriFlexible spending account and dependent FSA optionsHealth savings account for eligible plans with company contributionAnnual work-life stipends for:Home office setup, cell phone, internetWellness stipend for gym, massage/chiropractor, personal training, etc.Learning and development stipendCompany-wide off-sites and team off-sitesCompetitive compensation, company stock options and 401kWriter is an equal-opportunity employer and is committed to diversity. We don't make hiring or employment decisions based on race, color, religion, creed, gender, national origin, age, disability, veteran status, marital status, pregnancy, sex, gender expression or identity, sexual orientation, citizenship, or any other basis protected by applicable local, state or federal law. Under the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.By submitting your application on the application page, you acknowledge and agree to Writer's Global Candidate Privacy Notice.

Apply Now