[Remote] Data Engineer – AI | Remote
Note: The job is a remote job and is open to candidates in USA. Crossing Hurdles is seeking a Data Engineer specializing in AI. The role involves designing and optimizing AI/ML models, developing data pipelines, and integrating solutions within secure cloud environments.ResponsibilitiesDesign, implement, and optimize AI/ML models using large language models (LLMs), retrieval-augmented generation (RAG), and prompt engineering for production-grade applicationsDevelop and orchestrate multi-agent systems utilizing frameworks such as LangGraph and LangChainIntegrate and deploy solutions on secure cloud environments, including AWS GovCloud, Google GovCloud, Azure IL5+, Vertex AI, and AWS BedrockBuild robust data pipelines, manage ETL processes, and develop metadata catalogs and ontologies to ensure high-quality data for AI training and inferenceCreate and maintain REST APIs and SDK integrations to facilitate seamless data and model interactionsCollaborate with product, security, and engineering teams to ensure best-in-class delivery, adhering to secure coding and DevOps best practicesSkillsHave strong relevant experience in Python for AI/ML development, including proficiency with REST APIs and SDK integrationHave hands-on experience with LLMs, RAG systems, and prompt engineering in production environmentsBe familiar with multi-agent orchestration, tool use, and frameworks like LangGraph and LangChainPossess a deep understanding of cloud AI services, including AWS GovCloud, Google GovCloud, Azure IL5+, Vertex AI, and AWS BedrockHave a background in building and maintaining data pipelines, ontologies, metadata catalogs, and ETL processesCompany OverviewCrossing Hurdles connects skilled professionals with opportunities across AI training platforms and high-growth companies. It was founded in 2019, and is headquartered in Gurgaon, Haryana, IND, with a workforce of 11-50 employees. Its website is https://www.crossinghurdles.com.