[Remote] Senior AI Engineer, Agentic Systems

Note: The job is a remote job and is open to candidates in USA. AI Technology Partners (AITP) is a leader in delivering cutting-edge generative AI solutions and managed services, specializing in secure, customizable AI deployments for enterprises. In this role, you will lead the design and delivery of agentic systems that orchestrate tools, data, and policies to solve real business workflows safely and reliably. You will work closely with enterprise clients to translate their business processes into effective agentic designs.ResponsibilitiesDesign multi-agent architectures with robust state management, memory, and routingChoose and implement leading frameworks such as LangGraph/LangChain Agents, Microsoft AutoGen, CrewAI, LlamaIndex Agents, Semantic Kernel, or Haystack Agents—and justify trade-offsBuild modular components (planners, tool registries, policy guards, evaluators) that are reusable across clients and domainsIntegrate enterprise tools and data sources via function/tool calling, webhooks, and event-driven flows (Queues/Service Bus/Functions)Implement retrieval-augmented generation (RAG) patterns with vector stores (Azure AI Search, pgvector, MongoDB Atlas, Pinecone, Weaviate, Milvus) and structured knowledge (SQL/Graph)Add deterministic fallbacks, circuit breakers, and caching to keep latency and cost predictableDefine SLIs/SLOs for agent runs; implement tracing, metrics, and logging (e.g., Langfuse + OpenTelemetry) and build dashboards for run-level analyticsCreate evaluation harnesses (automatic + human-in-the-loop) using tools such as Ragas, DeepEval, promptfoo to measure groundedness, task success, safety, and costProductionize with CI/CD, environment promotion, feature flags, and canary strategies; optimize cost-per-task and time-to-successEnforce content and safety policies (redaction, classification, guardrails) with policy-as-code; implement role/tenant isolation and data minimizationCollaborate with security teams to align to ISO 27001/SOC 2/NIST/HIPAA/GDPR contexts; deliver audit-ready evidence for agentic workflowsBuild privacy-first patterns (no data exfiltration by default, least-privilege tool access, secure prompt/trace storage)Work directly with enterprise client teams to translate business processes into agentic designs; present trade-offs and proofs-of-value that lead to productionPartner with solution leads to create domain-specific agents (e.g., RFP assist, incident RCA drafting, knowledge ops) and reusable templatesSkills5–8+ years in software/platform engineering with recent production LLM applications (not just prototypes)Hands-on expertise with agentic frameworks (one or more of: LangGraph/LangChain Agents, AutoGen, CrewAI, LlamaIndex Agents, Semantic Kernel, Haystack Agents) and tool/function-calling patternsStrong RAG engineering across vector DBs, chunking/embedding strategies, metadata/search ranking, and grounding techniquesProven track record building observable, cost-aware, and secure LLM systems (tracing, evals, guardrails, secrets/IAM, PII handling)Solid software engineering fundamentals: Python/TypeScript, async patterns, APIs, testing, CI/CD, containerizationClear communicator who can interface with clients and write crisp technical docsAzure-first experience (Azure OpenAI, Azure AI Studio, Azure Functions/Container Apps/AKS, Private Link/VNet, Key Vault, Entra ID)Cross-cloud exposure (AWS/GCP) and hybrid integrations; experience with enterprise connectors (SharePoint/OneDrive, ServiceNow, Salesforce)Experience with structured output, constrained decoding, JSON Schemas, and program-of-thought planningBenefitsCompetitive and flexible compensation package aligned to experience, scope, and engagement modelBase salary, performance incentives, and equity participation, designed to reward meaningful contributions and impactChallenging work on meaningful, production agentic systems for enterprise clientsLearning & sharing culture with deep dives, brown bags, and support for certifications/publicationInclusive, flexible workplace—bring your whole self; work where you do your best thinkingCompany OverviewAI solutions and consulting It was founded in 2020, and is headquartered in Cambridge, Massachusetts, USA, with a workforce of 11-50 employees. Its website is https://aitp.ai.