[Remote] HPC Operations Engineering Manager

Note: The job is a remote job and is open to candidates in USA. Microsoft AI is seeking an experienced High Performance Computing Operations Engineering Manager to join their infrastructure team on the MAI SuperIntelligence Team. In this role, you’ll lead a team of Site Reliability Engineers to ensure the reliability and efficiency of large-scale distributed AI infrastructure while collaborating with ML researchers and product developers.ResponsibilitiesTeam leadership: Lead a team of experienced SREs to ensure uptime, resiliency and fault tolerance of AI model training and inference systemsObservability: Design and help maintain monitoring, alerting, and logging systems to provide real-time visibility into model serving pipelines and infraAutomation & Tooling: Lead building of automation for deployments, incident response, scaling, and failover in hybrid cloud/on-prem CPU+GPU environmentsIncident Management: Lead on-call rotations, troubleshoot production issues, conduct blameless postmortems, and drive continuous improvementsSecurity & Compliance: Ensure data privacy, compliance, and secure operations across model training and serving environmentsCollaboration: Partner with ML engineers and platform teams to improve developer experience and accelerate research-to-production workflowsSkillsBachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with Site Reliability Engineering, DevOps, or Infrastructure Engineering Leadership roles AND 8+ years experience with Kubernetes, Docker, and container orchestration, AND 6+ years experience with programming/scripting skills not limited to Python, Go, or BashOR equivalent experienceMaster's Degree in Computer Science or related technical field AND 12+ years technical engineering experience AND 10+ years experience with Kubernetes, Docker, and container orchestration, AND 10+ years' experience with public cloud platforms like Azure/AWS/GCP and infrastructure-as-code6+ years people management experience8+ years experience in monitoring & observability tools (Grafana, Datadog, OpenTelemetry, etc.)Knowledge of CI/CD pipelines for Inference and ML model deploymentSolid knowledge of distributed systems, networking, and storageExperience running large-scale GPU clusters for ML/AI workloads (preferred)Familiarity with ML training/inference pipelinesExperience with high-performance computing (HPC) and workload schedulers (Kubernetes operators)Background in capacity planning & cost optimization for GPU-heavy environmentsBenefitsCertain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-payCompany OverviewMicrosoft is a software corporation that develops, manufactures, licenses, supports, and sells a range of software products and services. It was founded in 1975, and is headquartered in Redmond, Washington, USA, with a workforce of 10001+ employees. Its website is https://www.microsoft.com.