Principal Network Architect- AI Infrastructure

Remote Full-time
What We Can Offer You



At Nscale, you'll find a collaborative, supportive, and innovative environment where your contributions spark real impact. We're building something extraordinary, and we want you at the core.

Highly competitive package (base + equity) with reviews every 12 months. 🚀

Join the fastest-growing tech startup, your chance to push boundaries, collaborate with brilliant minds, and make your mark on cutting-edge AI. ✨

Expect a dynamic progression plan tailored to your ambitions. Grow by trying new things, leading, challenging the status quo, and owning your impact, always with our full support.

Human-First Flexibility: We treat you as humans first. 🫶🏽 Our flexible workplace trusts Nscalers to deliver, giving you the autonomy to shape your day around life's moments.

About Nscale

Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large enterprise customers. Nscale enables AI-focused companies to achieve superior results by reducing the complexity of AI development. Our GPU cloud bolsters technical capabilities and directly supports strategic business outcomes, including cost management, rapid innovation, and environmental responsibility.

We thrive on a culture of relentless innovation, ownership, and accountability, where every team member takes pride in their work and drives it with excellence and urgency. As an Nscaler, you’ll build trust through openness and transparency, where everyone is inspired to do their best work. If you join our team, you’ll be contributing to building the technology that powers the future.



Role Overview

Nscale is seeking a Network Architect Engineer to lead the evolution, reliability, and operational excellence of our global AI networking infrastructure. This role sits at the core of Nscale’s platform, where network performance directly impacts AI training outcomes. You will act as a technical authority across large-scale RDMA / Infiniband / RoCE fabrics, driving automation, availability improvements, and system-level design across a globally distributed GPU cloud. You will combine deep network protocol-level networking expertise with strong software and automation skills to operate and scale one of the most demanding AI networking environments in the industry.



What You’ll Do

Technical Leadership & Strategy

Own the technical direction and operational lifecycle management of Nscale’s high-performance RDMA network fabrics

Define long-term architecture, reliability strategy, and operational standards for AI interconnect networks

Lead availability and performance improvement initiatives across globally distributed GPU clusters

Act as a technical authority (SME) across networking, influencing platform-wide decisions

Network Engineering & Operations

Support design, build, and evolve large-scale Infiniband and RoCE fabrics

Drive deep debugging and resolution of complex cross-layer issues (hardware, firmware, kernel, distributed workloads)

Lead incident response and postmortems, ensuring systemic fixes and long-term improvements

Define and enforce standards across:

Congestion control and traffic engineering

Routing (BGP, ECMP, fabric-level routing strategies)

Firmware lifecycle and change management

Network observability and telemetry

Automation & Systems Development

Develop and scale automation frameworks for network provisioning, validation, and operations

Build tooling to support high-reliability, low-touch network operations at scale

Improve operational efficiency across hundreds of thousands of endpoints and high-throughput links



Cross-Functional Leadership

Lead complex technical initiatives across Network, SRE, Compute, and Platform teams

Serve as technical lead on critical programs, coordinating engineers and stakeholders

Influence product and infrastructure roadmaps based on operational insights and customer needs

Mentor senior engineers and raise the bar for technical rigor and execution



What We’re Looking For

Core Experience

10+ years of experience in network engineering in hyperscale, AI, or HPC environments

Deep expertise in RDMA, Infiniband, and/or large-scale RoCE fabrics

Strong understanding of:

RDMA internals and performance tuning

Congestion control and fabric failure modes

Distributed system communication patterns

Technical Skills

Expert-level knowledge of data center networking protocols (BGP, OSPF, ECMP)

Proven ability to debug multi-layer issues across network, system, and application layers

Strong programming/scripting skills for automation (Python, Go, etc.)

Experience designing high-scale, highly available network systems

Leadership & Impact

Demonstrated ability to lead complex technical programs without direct authority

Experience acting as a senior escalation point for critical production issues

Strong ability to drive cross-team alignment and execution

Systems-level thinking balancing performance, reliability, scalability, and cost

Nice to Have

Experience with NVIDIA / Mellanox networking platforms

Familiarity with distributed AI training frameworks and GPU communication patterns

Experience building network observability systems at scale

Background influencing infrastructure strategy in high-growth environments



Equal Opportunities Statement

We strongly encourage applications from people of colour, the LGBTQ+ community, people with disabilities, neurodivergent people, parents, carers, and people from lower socio-economic backgrounds.

If there’s anything we can do to accommodate your specific situation, please let us know.

The responsibilities outlined in this job description are not exhaustive and are intended to provide a general overview of the position. The employee may be required to perform additional duties, tasks, and responsibilities as assigned by management, consistent with the skills and qualifications required for the role.

For information on how Nscale handles candidate personal data, please see our Employee & Candidate Privacy Notice: Here.
Apply Now →

Similar Jobs

Experienced Registered Behavior Technician for In-Home ABA Therapy - Atlanta, GA

Remote

Immediate Hiring: Experienced Registered Behavioral Technician (RBT) for Clinic-Based ABA Therapy Services

Remote

Experienced Registered Behavioral Technician (RBT) - ABA Therapy for Children with Autism Spectrum Disorder

Remote

Experienced Registered Nurse - Telehealth: Providing Remote Care Coordination and Patient Support

Remote

Experienced Substitute Teacher for Riverside County Schools - Join Scoot Education's Innovative Team

Remote

Experienced Substitute Teacher for San Bernardino County - Flexible Schedules & Competitive Pay

Remote

Experienced School Year Instructional Coach for High-Dosage Tutoring Programs in Edgewater Park, NJ

Remote

Experienced School Year Tutor for K-8 Students in Math and Literacy - Mickleton, NJ

Remote

Experienced Secondary Social Studies Teacher for Kansas - Flexible Hybrid Remote Arrangement

Remote

USPS Office Helper

Remote

Immediately Require Online English Teacher (100% Remote) in Milton, VT

Remote

Opportunity For FULL TIME Data Entry Part - Time At Students

Remote

Part Time CVS Remote Careers (Remote Data Entry Jobs) - Indeed

Remote

ESG Reporting Manager

Remote

Vietnamese Onsite Interpreter

Remote

Enterprise Editorial Journalist job at Elevance Health in Indianapolis, IN, Chicago, IL, Minneapolis, MN

Remote

Graphic Designer

Remote

InP - Call Center Supervisor I

Remote

Senior Director of Financial Planning, Analysis

Remote

Instructional Coach, K-5

Remote
← Back