[Remote] AI Engineer

Note: The job is a remote job and is open to candidates in USA. ETS is a global education and talent solutions organization dedicated to advancing fair and valid skill assessments. They are seeking an AI Model Development Engineer to design, develop, evaluate, and deploy machine learning models for assessment technologies, focusing on AI-driven scoring systems for various response types.ResponsibilitiesDevelop, train, and optimize machine learning and deep learning models for applications such as automated scoring (including text, speech, or multimodel responses), item generation, content classification, anomaly detection, and personalizationImplement feature engineering, representation learning, and model architectures appropriate for scoring and classification tasksDevelop hybrid scoring approaches combining AI models with rules-based or human-in-the-loop workflowsUse NLP, large language models, and multimodal modeling techniques to support assessment creation, delivery, and feedbackBuild model pipelines, evaluation frameworks, and testing approaches to ensure models are valid, reliable, fair, and aligned with ETS’s Responsible AI guidelinesCollaborate with psychometric and validity teams to ensure AI-driven systems meet technical, fairness, and measurement standardsPartner with engineering teams to deploy models into scalable, production-grade systems integrated with ETS operational platformsConduct experiments to compare model architectures, datasets, training regimes, and performance tradeoffsImplement monitoring solutions to track model drift, robustness, and security risks over timeParticipate in cross-functional design sessions, helping translate assessment or business needs into implementable AI solutionsDocument model design, training data specifications, evaluation metrics, and deployment requirementsStay current with advancements in LLMs, generative AI, responsible AI, and educational technology, bringing forward ideas for innovationSkillsBachelor's or Master's degree in Computer Science, Machine Learning, Data Science, Engineering, or related field3+ years of experience developing machine learning models in production environments, preferably in large scale scoring environmentsHands-on experience developing and deploying machine learning or deep learning models (TensorFlow, PyTorch, JAX, or equivalent)Experience with NLP techniques and models, including transformer architectures and LLM fine-tuning and/or speech processing (e.g., text classification, embeddings, ASR outputs)Strong proficiency in Python and familiarity with modern MLOps tools (MLflow, Kubeflow, KServe, or equivalent)Demonstrated experience evaluating model performance using appropriate metrics and validation strategiesUnderstanding of model evaluation, bias and fairness assessment, and statistical validationAbility to work collaboratively with researchers, engineers, and product teamsBenefitsETS offers multiple Business Resource Groups (BRG) for you to learn and advance your career growth!At ETS you may qualify for up to an additional 8 hours of PTO for volunteer work on causes that are important to you!Company OverviewETS is a global education and talent solutions organization, enabling lifelong learners to be future ready. It was founded in 1947, and is headquartered in Princeton, New Jersey, USA, with a workforce of 1001-5000 employees. Its website is http://www.ets.org.Company H1B SponsorshipETS has a track record of offering H1B sponsorships, with 4 in 2026, 85 in 2025, 39 in 2024, 127 in 2023, 60 in 2022, 43 in 2021, 55 in 2020. Please note that this does not guarantee sponsorship for this specific role.