Prompt Engineer (New Grad)

Wisedocs is a fast-growing, venture-backed AI platform that transforms how insurance companies analyze claims. The Prompt Engineer will evaluate and test AI model outputs related to healthcare, collaborating with engineering and product teams to ensure quality and compliance.ResponsibilitiesTest AI-generated outputs, focusing on medical prompts and machine learning models used in healthcare applicationsAnalyze AI output for accuracy, relevance, and clinical validityProvide detailed feedback to the engineering team to enhance prompt performance and model behaviorWrite, maintain, and update detailed SOPs for medical prompt engineering and testing, ensuring consistency and quality in prompt creation and validationWork closely with the engineering team to troubleshoot, refine, and optimize machine learning models based on feedback from prompt testing and evaluationEnsure that the AI-generated responses align with clinical guidelines, best practices, and healthcare regulationsAssist in analyzing medical data sets and model outputs to evaluate the performance of AI models in clinical contextsDocument all testing procedures, outcomes, and improvementsCreate user-friendly guides and best practice documents for prompt testing and optimizationActively participate in the iterative process of improving prompt accuracy, functionality, and overall system performance in collaboration with cross-functional teamsSkillsA degree in medicine, nursing, medical informatics, or a related field, or significant hands-on clinical experienceFamiliarity with AI, machine learning models, and prompt engineering, especially in healthcare or clinical settingsExperience with testing and evaluating technology solutions, particularly in the healthcare or technology spaceExperience writing clear, concise, and detailed Standard Operating Procedures (SOPs) and documentationExcellent written and verbal communication skills, with the ability to deliver technical feedback in a clear and constructive mannerStrong attention to detail, particularly when reviewing AI outputs for clinical accuracy and relevanceAbility to identify issues, propose solutions, and collaborate with engineering teams to resolve challengesKnowledge of HIPAA, medical privacy laws, and healthcare compliance standardsExperience with data analysis tools, basic coding (Python, R, etc.) and SQLPrevious work with AI models in a medical context, such as AI-powered medical documentation systems, diagnostic tools, or virtual health assistantsBenefitsFlexible hybrid environment with the option to collaborate in-person at our Toronto HQ.Modern employee benefits, including health and dental coverageCompetitive compensation, with valuable stock options, as we’re still a young company growing very quickly.An opportunity to develop very rapidly in your career.Access to a learning and professional development fund to help you level up your career while you’re working with us.Company eventsGenerous Paid Time OffPaid Sick DaysCasual Dress codeEmployee Referral BonusTuition AssistancePlus, many other Recognition Programs!Company OverviewWisedocs provides medical record indexing, review, and AI summaries for various markets. It was founded in 2018, and is headquartered in Toronto, Ontario, CAN, with a workforce of 51-200 employees. Its website is https://www.wisedocs.ai.