QA Engineer, AI – Platform Infrastructure
Job Description:
• Subject Matter Expert for the design, maintenance, and implementation of automated and manual test frameworks covering backend APIs, frontend components, containerized services, and AI/LLM-powered workflows.
• Design, implement, and maintain CI/CD-integrated QA pipelines using Docker Compose and Kubernetes environments.
• Conduct performance and load testing for containerized and GPU-enabled applications, identifying bottlenecks and reliability risks.
• Validate AI workflow correctness, including LangChain pipelines, CrewAI task orchestration, and LlamaIndex document processing flows.
• Develop internal testing tools and frameworks in TypeScript, Python, or Bun to improve platform reliability and developer velocity.
• Reproduce, isolate, and report defects with high-quality context; work closely with developers to drive rapid resolution.
• Consult and collaborate with SMEs across Engineering, Product, DevOps, and AI/ML teams to define quality standards and establish test plans for new services and UI components.
• Lead the creation, modification, and maintenance of QA documentation, including test plans, test case libraries, defect reports, and quality metrics dashboards.
• Influence cross-functional groups regarding testability, technical feasibility, and quality requirements during design and development phases.
• Assist with the planning and implementation of QA-driven process improvements and tooling upgrades in collaboration with cross-functional teams.
• Lead integration, regression, and acceptance testing activities for new features and infrastructure changes.
• Provide technical mentoring and oversight to less experienced engineers on testing best practices, tooling, and defect management.
• Create, edit and adhere to Standard Operating Procedures (SOPs), process improvements, and standardization of templates.
• Performs ad-hoc and cross-functional duties and/or projects assigned to support business needs and provide developmental opportunities.
Requirements:
• Bachelor’s degree in computer science, Software Engineering, or a related field is required.
• 3+ years of experience in software QA or test automation is required.
• Experience with containerized environments (Docker, Docker Compose, Kubernetes) is required.
• Experience with Python and TypeScript for writing tests and automation scripts is required.
• Experience with modern web frameworks (React, Next.js, Svelte) and E2E/UI testing tools such as Playwright or Cypress is required.
• Experience with CI/CD workflows (GitHub Actions, Jenkins, or similar) is required.
• Experience with AI systems testing, particularly LangChain, CrewAI, or LlamaIndex, is preferred.
• Experience with performance testing or benchmarking AI-driven applications is preferred.
Benefits:
• Medical, Dental and Vision Plan Options
• Health and Financial Wellness Programs
• Employer Assistance Program (EAP)
• Company Paid and Voluntary Life/AD&D, Short-Term and Long-Term Disability
• Healthcare and Dependent Care Flexible Spending Accounts
• 401(k) Retirement Plan with Company Match
• 529 Education Savings Program
• Voluntary Legal Services, Identity Theft Protection, Pet Insurance and Employee Discounts, Rewards and Perks
• Paid Time Off (PTO) includes: 11 Holidays
• Exempt Employees are eligible for Unlimited PTO
• Non-Exempt Employees are eligible for 10 Vacation Days, 56 Hours of Health Pay, 2 Personal Days and 1 Cultural Day
Apply tot his job
Apply To this Job
• Subject Matter Expert for the design, maintenance, and implementation of automated and manual test frameworks covering backend APIs, frontend components, containerized services, and AI/LLM-powered workflows.
• Design, implement, and maintain CI/CD-integrated QA pipelines using Docker Compose and Kubernetes environments.
• Conduct performance and load testing for containerized and GPU-enabled applications, identifying bottlenecks and reliability risks.
• Validate AI workflow correctness, including LangChain pipelines, CrewAI task orchestration, and LlamaIndex document processing flows.
• Develop internal testing tools and frameworks in TypeScript, Python, or Bun to improve platform reliability and developer velocity.
• Reproduce, isolate, and report defects with high-quality context; work closely with developers to drive rapid resolution.
• Consult and collaborate with SMEs across Engineering, Product, DevOps, and AI/ML teams to define quality standards and establish test plans for new services and UI components.
• Lead the creation, modification, and maintenance of QA documentation, including test plans, test case libraries, defect reports, and quality metrics dashboards.
• Influence cross-functional groups regarding testability, technical feasibility, and quality requirements during design and development phases.
• Assist with the planning and implementation of QA-driven process improvements and tooling upgrades in collaboration with cross-functional teams.
• Lead integration, regression, and acceptance testing activities for new features and infrastructure changes.
• Provide technical mentoring and oversight to less experienced engineers on testing best practices, tooling, and defect management.
• Create, edit and adhere to Standard Operating Procedures (SOPs), process improvements, and standardization of templates.
• Performs ad-hoc and cross-functional duties and/or projects assigned to support business needs and provide developmental opportunities.
Requirements:
• Bachelor’s degree in computer science, Software Engineering, or a related field is required.
• 3+ years of experience in software QA or test automation is required.
• Experience with containerized environments (Docker, Docker Compose, Kubernetes) is required.
• Experience with Python and TypeScript for writing tests and automation scripts is required.
• Experience with modern web frameworks (React, Next.js, Svelte) and E2E/UI testing tools such as Playwright or Cypress is required.
• Experience with CI/CD workflows (GitHub Actions, Jenkins, or similar) is required.
• Experience with AI systems testing, particularly LangChain, CrewAI, or LlamaIndex, is preferred.
• Experience with performance testing or benchmarking AI-driven applications is preferred.
Benefits:
• Medical, Dental and Vision Plan Options
• Health and Financial Wellness Programs
• Employer Assistance Program (EAP)
• Company Paid and Voluntary Life/AD&D, Short-Term and Long-Term Disability
• Healthcare and Dependent Care Flexible Spending Accounts
• 401(k) Retirement Plan with Company Match
• 529 Education Savings Program
• Voluntary Legal Services, Identity Theft Protection, Pet Insurance and Employee Discounts, Rewards and Perks
• Paid Time Off (PTO) includes: 11 Holidays
• Exempt Employees are eligible for Unlimited PTO
• Non-Exempt Employees are eligible for 10 Vacation Days, 56 Hours of Health Pay, 2 Personal Days and 1 Cultural Day
Apply tot his job
Apply To this Job