[Remote] Sr AI Engineer
Note: The job is a remote job and is open to candidates in USA. Vaiticka Solution is seeking a Senior AI Engineer to design, build, and deploy high-quality AI-powered features with end-to-end ownership. The role involves ensuring reliable, scalable, and impactful AI solutions through the full lifecycle of prototyping to production.ResponsibilitiesEnd-to-End AI Feature OwnershipDesign and implement AI-powered features (LLM workflows, copilots, and agent-based systems with tool use and multi-step reasoning)Own the Full Lifecycle: prototyping โ evaluation โ production deployment โ iterationEnsure solutions are reliable, performant, and aligned with product needsAI System ImplementationBuild and optimize prompt pipelines for specific use casesBuild retrieval systems (embeddings, chunking, ranking)Implement RAG-based workflows where neededIterate on outputs to improve quality, accuracy, and consistencyDesign scalable and cost-efficient AI architectures for production workloadsSelect and evaluate models (hosted vs open source) based on use case constraintsAgent-Based Systems (AgentCore)Design and build agentic workflows capable of multi-step reasoning and decision-makingIntegrate agents with tools, APIs, and internal systems to perform real-world actionsImplement planning, execution, and reflection loops for complex tasksManage context, memory, and state across multi-step interactionsBalance deterministic workflows vs. agent autonomy for reliability and controlExperimentation & EvaluationRun structured experiments to compare approaches (prompting, retrieval, models)Define and track key metrics for AI performance (quality, latency, cost)Debug and improve non-deterministic system behaviorBuild and maintain evaluation datasets and benchmarksImplement automated evaluation pipelines for continuous improvementCollaboration & ContributionDrive technical direction and influence AI adoption across teamsPartner with product managers and designers to scope AI featuresContribute to shared patterns and reusable componentsParticipate in code reviews and design discussionsSupport and mentor mid-level engineers where neededAI Reliability, Safety & GovernanceDesign guardrails to ensure safe and reliable AI behaviorMitigate hallucinations, prompt injection, and model misuseEnsure compliance with data privacy and enterprise requirementsImplement monitoring and observability for AI systems in productionImplement guardrails for agent actions (tool access control, execution boundaries)Prevent failure cascades in multi-step agentSkillsStrong understanding of LLM capabilities and limitationsExperience with prompt engineering and structured output designHands-on experience with embeddings and vector searchFamiliarity with RAG architectures and when to apply themExperience designing agent-based architectures (AgentCore concepts)Understanding of tool use, planning strategies, and memory mechanisms in LLM systemsCompany OverviewWe connect great companies with the right talent. It was founded in undefined, and is headquartered in Georgia, GA, US, with a workforce of 51-200 employees. Its website is https://www.vaiticka.com.