Senior Quality Assurance Automation Engineer

Remote Full-time
We are looking for a Senior AQA to join a skilled development squad. You will be joining a department of 70+ engineers across 8 squads, each with ownership for specific domains within our flagship SaaS based enterprise architecture product, OrbusInfinity.
OrbusInfinity is at the forefront of AI-driven enterprise transformation – combining strategy, architecture, process, and portfolio management into a unified intelligence platform, with AI-driven features and a growing suite of AI agents via OrbusInfinity CoPilot. As we scale our AI services into production, quality engineering has never been more critical or more exciting.
As part of the role, you will work closely within your squad alongside other Automation QAs, full-stack Developers, a dedicated Product Owner and Scrum Master, to ensure that high-quality solutions are produced to solve real user problems. We have well-established testing solutions – Functional UI Testing, API Integration Tests, UI Component Integration Tests, API Performance Tests and Unit Tests – and we are now extending these practices into AI service validation, LLM output testing, and agentic workflow quality assurance. As an Automation QA, you will be designing test scenarios and choosing the appropriate test solution to ensure high quality and repeatable testing of application components.
We operate Scrum for day-to-day development, wrapped with quarterly strategic alignments. We follow leading practices: TDD, automated CI/CD, a β€œshift-left” testing mindset, and a focus on S.O.L.I.D maintainable code. We also embrace AI-assisted development workflows – from AI-augmented code review to agent-assisted test generation – and we expect our senior engineers to lead the way in adopting and shaping these practices.
We have Communities of Practice (Guilds) covering architecture, quality, agile practices, and DevOps. As a Microsoft Gold partner we benefit from early access to the latest tooling. We host regular Tech Talks and Knowledge Sharing cross-team – and our QA Guild is actively building out best practices for AI quality engineering. If this sounds like you, we’d love to hear from you.
The role is fully remote, with some office time encouraged during onboarding along with the rest of the team to get some face time both in the office and socially.
Core Responsibilities:
β€’ Working in a Scrum Squad of 3-4 other Developers and 1 other Automation QA
β€’ Following and maintaining established QA best practices within the squad
β€’ Collaborating with the Product Owner and Squad to refine Stories and Acceptance Criteria, including criteria for AI-driven features
β€’ Collaborating with the squad to design and review test scenarios and develop C# Integration Tests, React tests in Playwright, Contract Tests (Pact) and UI Functional Tests in C# with Playwright
β€’ Quickly identifying high-level test strategies and quality risks, including those unique to AI/ML systems (hallucination, drift, latency)
β€’ Monitor and report on quality trends such as bug churn
β€’ Leveraging AI tooling (e.g. GitHub Copilot, AI test generation tools) to accelerate test authoring and analysis
β€’ Analyze automation test run results
β€’ Adhering to existing coding standards and practices
β€’ Partaking in code review culture and technical collaboration
β€’ Attending squad meetings such as daily Stand-ups, Retrospectives, Planning, Refinements, and technical discussions
β€’ Partaking in presentations and code workshops

Essential:
β€’ 5+ years in a Quality Assurance role
β€’ C# .Net/Net Core – 3+ years
β€’ Typescript knowledge
β€’ API Integration Test experience supporting regular production releases
β€’ Functional UI Test experience with Playwright
β€’ Excellent testing fundamentals, such as test design, defect management and high attention to detail
β€’ Understanding of object-oriented programming (OOP) and S.O.L.I.D principles
β€’ Experience with Scrum and development in an agile environment
β€’ Understanding of CI/CD processes that support automated testing
β€’ Demonstrated use of AI tools in day-to-day engineering work (e.g. AI-assisted coding, test generation, or analysis)

Desirable:
β€’ Experience testing AI services or LLM-powered features in a production environment
β€’ Familiarity with AI agent frameworks (e.g. AutoGen, LangChain, Semantic Kernel) and understanding of agentic system behaviours
β€’ Awareness of non-deterministic testing strategies: probabilistic assertions, golden-set evaluation, adversarial prompt testing
β€’ Playwright, React exposure
β€’ Experience working on an existing production SaaS platform
β€’ Azure familiarity
β€’ Exposure to Micro-frontends and Microservices
β€’ Confidence with git and branching

Orbus Tech Stack/Environment:
β€’ Development for modern browsers
β€’ .NET 10 / C#
β€’ React, Typescript, HTML, SASS
β€’ SQL Server (T-SQL), CosmosDB
β€’ MSTEST v2, XUnit, Mock, NSubstitute, Jest, Playwright
β€’ Azure DevOps with Git, and CI/CD pipelines in YAML
β€’ IAC (ARM, Helm, Terraform)
β€’ Containers, Kubernetes
β€’ Azure native technologies (i.e. App Services, Functions etc.)
β€’ AI/ML tooling: Azure OpenAI, Semantic Kernel, LLM evaluation frameworks

What’s in it for you!
β€’ A massive opportunity for you to develop your skills and knowledge in a supportive environment that thrives on growth and change.
β€’ An opportunity to develop skills in AI quality engineering, a rapidly growing discipline
β€’ Competitive salary and benefits (in line with experience)
β€’ Fully remote working policy or the option to work hybrid model
β€’ Curious, open culture, with teams collaborating across geographies
Apply Now β†’

Similar Jobs

Experienced Registered Behavior Technician for In-Home ABA Therapy - Atlanta, GA

Remote

Immediate Hiring: Experienced Registered Behavioral Technician (RBT) for Clinic-Based ABA Therapy Services

Remote

Experienced Registered Behavioral Technician (RBT) - ABA Therapy for Children with Autism Spectrum Disorder

Remote

Experienced Registered Nurse - Telehealth: Providing Remote Care Coordination and Patient Support

Remote

Experienced Substitute Teacher for Riverside County Schools - Join Scoot Education's Innovative Team

Remote

Experienced Substitute Teacher for San Bernardino County - Flexible Schedules & Competitive Pay

Remote

Experienced School Year Instructional Coach for High-Dosage Tutoring Programs in Edgewater Park, NJ

Remote

Experienced School Year Tutor for K-8 Students in Math and Literacy - Mickleton, NJ

Remote

Experienced Secondary Social Studies Teacher for Kansas - Flexible Hybrid Remote Arrangement

Remote

USPS Office Helper

Remote

Brewery Representative

Remote

Experienced Remote Data Entry Specialist – Flexible Online Work Opportunities

Remote

Vehicle Delivery Driver

Remote

Remote Inside Sales Executive Opportunity - Unlock Your Earning Potential

Remote

Experienced Remote Customer Service Representative – Delivering Exceptional Support to Diverse Customer Base at arenaflex

Remote

**Experienced Full Stack Data Scientist – High Tech Manufacturing Customer Success Lead**

Remote

Go-to-Market Engineer - Virginia Beach, VA, USA

Remote

Senior Clinical Research Associate

Remote

Sr. Network Engineer

Remote

Customer Service & Repair Coordination Specialist – On-Site Operations & Client Success

Remote
← Back