[Remote] Senior AI Engineer

Note: The job is a remote job and is open to candidates in USA. QuinStreet is a pioneer in powering decentralized online marketplaces that connect consumers with brands through innovative technologies. They are seeking a Senior AI Developer & Cloud Architect to design and build an AI-powered compliance scraping engine and cloud infrastructure for monitoring credit card offer pages, ensuring high accuracy and controlled costs.ResponsibilitiesDesign and configure the production AWS environment (ECS/Fargate, SQS, API Gateway, RDS PostgreSQL, S3, IAM, CloudWatch) using infrastructure as code (Terraform or CDK)Build a stateless, containerized worker fleet that integrates Playwright-based page rendering, structured rule evaluation, and Claude API analysisImplement token optimization strategies across the LLM pipeline — prompt engineering, context pruning, caching, model selection, and batching — with measurable cost outcomesDefine and document API contracts, job payload schemas, and database write patterns with the internal Laravel portal team to enable parallel developmentBuild third-party API ingestion and field-level diff-detection logic that automatically adjusts monitoring rules when product data changesHandle modern web rendering challenges at scale: JavaScript-heavy SPAs, interstitials, cookie consent overlays, dynamic content, viewport switching, and full-page screenshot captureEvaluate when LLM analysis is the correct tool versus a classifier or rules-based approach, and design the two-stage rule-engine-plus-AI pipeline accordinglyBuild and maintain a unit test suite covering all modules and APIs to ensure uptime and proper functionalityDocument every architecture decision, configuration, API contract, and operational procedure continuously — not as a final-week deliverableDeliver a complete runbook and knowledge transfer to the internal team at engagement closeOperate independently end-to-end while coordinating closely with the internal portal team and reporting directly to the Senior Director, surfacing risks and trade-offs earlySkillsProduction backend Python experience, including async patterns, type hints, packaging, and testingDirect production experience designing and configuring AWS ECS/Fargate, SQS, API Gateway, RDS (PostgreSQL), S3, IAM, and CloudWatch, with infrastructure as code (Terraform or CDK)Real shipped systems calling the Anthropic Claude API in production, with demonstrated experience in prompt design, structured output, error handling, and cost trade-offsDemonstrated track record reducing token spend on production LLM workloads, with specific before/after results you can walk throughWorking knowledge of other LLM providers sufficient to recommend cheaper or better alternatives for specific tasksProduction Playwright experience at scale, including headless Chromium failure modes, network idle detection, dynamic content handling, viewport switching, and screenshot strategy. Selenium or Puppeteer experience does not substituteMachine learning fundamentals sufficient to evaluate when LLM analysis is the right tool versus a classifier or rules-based approach, and to reason about evaluation and false-positive ratesDocker and containerization experience, including image optimization, ECR, and stateless worker designAbility to operate fully independently — no engineering team underneath you — while documenting continuously and coordinating cleanly with an internal teamExperience with API ingestion and field-level diff-detection systemsLaravel or PHP familiarity, enough to coordinate cleanly on API contracts with the portal teamSOC 2 Type II compliance experienceSalesforce API integration experienceRegulated-industry experience (financial services, healthcare, or insurance)BenefitsThis position is eligible to participate in the Company’s standard employee benefits programs, which currently include health care benefits.Company OverviewQuinStreet is an online performance marketing company providing technologies for businesses to identify their targeted audiences. It was founded in 1999, and is headquartered in Foster City, California, USA, with a workforce of 501-1000 employees. Its website is http://www.quinstreet.com.Company H1B SponsorshipQuinStreet has a track record of offering H1B sponsorships, with 2 in 2026, 24 in 2025, 31 in 2024, 19 in 2023, 40 in 2022, 22 in 2021, 14 in 2020. Please note that this does not guarantee sponsorship for this specific role.