[Remote] Founding Machine learning Engineer - Evaluation

Note: The job is a remote job and is open to candidates in USA. Established Search is focused on building evaluation and evidence infrastructure for safety-critical AI systems, particularly in diagnostic medical imaging. The role involves investigating how AI systems behave in practice, designing evaluations, and generating evidence necessary for deployment and regulatory decisions.ResponsibilitiesDesign and execute evaluations for medical imaging AI systemsInvestigate model failure modes, robustness, and generalization gapsAnalyze behavior across populations, scanners, imaging protocols, and clinical settingsDetermine what evidence is sufficient for stakeholders making deployment or regulatory decisionsTranslate technical findings into actionable recommendations for customers and clinical stakeholdersBuild reusable evaluation pipelines, evidence schemas, and model assessment frameworksWork with messy, incomplete, and noisy real-world clinical dataHelp shape how evaluation investigations are conducted across the organizationSkillsStrong experience in machine learning for medical imaging (radiology, pathology, cardiology imaging, or related domains)Experience evaluating or validating real-world ML systems, not just training modelsDeep understanding of: model robustness, distribution shift, uncertainty, failure analysis, and real-world deployment behaviorStrong Python skills across the full investigation workflow: data analysis, experimentation, evaluation, and reportingExperience working with noisy or imperfect clinical datasetsAbility to communicate technical findings clearly to both technical and non-technical stakeholdersHigh tolerance for ambiguity and open-ended investigative workExperience with FDA-regulated AI/ML systems or medical device submissions (510(k), De Novo, SaMD, etc.)Experience with medical imaging deployment evaluation or clinical validationExperience with interpretability, post-deployment monitoring, uncertainty estimation, or model auditingExperience designing reproducible evaluation frameworks or benchmarking systemsBackground in healthcare AI or other safety-critical ML domainsCustomer-facing or cross-functional technical leadership experiencePhD or equivalent research depth in ML, medical imaging, computer vision, or related areasCompany OverviewEstablished Search is a global executive search firm focused on providing talent solutions across a broad range of job functions. It was founded in 2023, and is headquartered in Leeds, GB, with a workforce of 11-50 employees. Its website is https://established-search.com/.