[Remote] Software Engineer( AI Platform Engineer)

Note: The job is a remote job and is open to candidates in USA. Xylo Technologies is seeking a Senior Software Engineer for AI Platform Engineering. The role involves designing high-performance hosting environments and building scalable hybrid-cloud infrastructure for AI capabilities, ensuring operational excellence and collaboration with cross-functional teams.ResponsibilitiesDesign and implement high-performance hosting environments for both specialized models and autonomous agentsBuild multi-tenant platform capabilities that support seamless agent and model execution across diverse cloud and on-prem environmentsImplement robust solutions for real-time monitoring, distributed tracing, and automated evaluation of agents & models in productionAct as a member of our rotational platform operational team, ensuring the reliability and uptime of critical AI servicesPartner with cross-functional AI teams to identify system friction, streamlining their workflows and accelerating the delivery of AI-driven valueSkillsProven experience building scalable back-end systems, ideally with a focus on containerization and orchestration (4+ years of in-depth Kubernetes is a must)Strong understanding of the lifecycle of LLMs and autonomous agents, including inference optimization and RAG architecturesA track record of implementing observability (logging, metrics, tracing) in complex, distributed environmentsThe ability to turn abstract AI research into production-grade, hardened platform featuresHave in-depth knowledge of software engineering with experience coding applications or services in a high-level programming language, preferably Python, and a basic knowledge of related fieldsDemonstrated problem solving and time management skillsPossesses strong technical aptitude for designing and implementing software solutionsExperience with modern application development frameworksKnowledge of professional software engineering practices & best practices for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operationsDeep hands-on technical expertise, excellent verbal and written communication skillsExperience with Agile software development techniquesBachelor's Degree in Computer Science/Engineering or related field with 5 years of experience as noted below; OR an Associate's degree in Computer/Science/Engineering or related field with 7 years of experienceAbility to use a wide variety of open-source technologies and cloud-based servicesExperience writing software for hybrid cloud (GCP, AWS, Azure)Experience building high-performance, highly available and scalable distributed systemsExperience developing software for healthcare related industriesCompany OverviewOver the past decade, Xylo Technologies has emerged as a leading provider of technology based solutions. It was founded in 2000, and is headquartered in Rochester, Minnesota, USA, with a workforce of 51-200 employees. Its website is https://xylotechnologies.com.Company H1B SponsorshipXylo Technologies has a track record of offering H1B sponsorships, with 2 in 2025, 2 in 2024, 1 in 2023, 1 in 2022, 2 in 2021, 9 in 2020. Please note that this does not guarantee sponsorship for this specific role.