[Remote] AI Infrastructure Engineer

Note: The job is a remote job and is open to candidates in USA. Bright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their operations. They are seeking an AI Infrastructure Engineer to design, build, and operate the platform layer that powers large-scale AI training and inference workloads, focusing on GPU clusters and ensuring reliability and efficiency.ResponsibilitiesDesign and operate GPU and accelerator infrastructure for training and inference, spanning on-prem clusters, cloud-managed services, and hybrid configurationsBuild scheduling, queueing, and resource-sharing systems that maximize accelerator utilization across many teamsIntegrate frameworks such as PyTorch, JAX, DeepSpeed, FSDP, Megatron-LM, and Ray Train into a unified platform offeringOperate high-performance storage systems and data pipelines that keep accelerators fed with training data at near-line-rateDesign networking architectures supporting RDMA, InfiniBand, NCCL, and high-bandwidth collective communicationBuild observability for AI workloads including utilization, throughput, training stability, and failure-mode analyticsImplement checkpointing, restart, and fault-tolerance patterns for long-running training jobs at scaleDrive cost optimization across compute, storage, and networking through scheduling, spot capacity, and right-sizingDevelop developer tooling and paved-road workflows that let researchers launch experiments safely and efficientlyPartner with research and applied ML teams to plan capacity for upcoming training runsImplement security controls, isolation, and access management for multi-tenant AI infrastructureDrive automation across cluster provisioning, lifecycle management, and configuration enforcementMaintain runbooks, capacity dashboards, and operational documentation for the AI platformStay current with AI infrastructure research, accelerator hardware, and emerging open-source AI toolingSkillsBachelor's or Master's degree in Computer Science or a related fieldSix or more years of experience in infrastructure, platform, or HPC engineeringHands-on experience operating GPU clusters or large-scale ML training infrastructureStrong proficiency in Python and at least one systems language such as Go or C++Deep understanding of distributed training, accelerator architectures, and collective communicationExperience with Kubernetes, Slurm, Ray, or similar scheduling systems for ML workloadsStrong understanding of Linux internals, networking, and high-performance storageExperience with at least one major cloud provider's ML infrastructure offeringsStrong software engineering practices including testing, CI/CD, and code reviewExcellent communication and cross-functional collaboration skillsExperience operating InfiniBand or RDMA networking at scaleContributions to open-source ML infrastructure projectsFamiliarity with custom orchestrators or research-grade training stacksExposure to frontier model training operationsExperience with FinOps for AI workloadsBenefitsCompetitive base salary commensurate with experience, plus benefits.Full-time, direct W2 with Bright Vision Technologies (no C2C, no 1099, no third-party)100% remote, full-time, direct W2 position with Bright Vision Technologies.We will support H1B transfers for qualified candidates.Company OverviewBright Vision Technologies is an information technology company that offers software development, AI, and cybersecurity services. It was founded in 2020, and is headquartered in Bridgewater, New Jersey, USA, with a workforce of 51-200 employees. Its website is https://bvteck.com.