Associate Data Scientist

Manulife is a leading international financial services provider, and they are seeking an Associate Data Scientist to design, evaluate, and deploy LLM-based applications. This role involves collaborating on projects that utilize cutting-edge LLM technologies, ensuring model performance and alignment while gaining real-world experience in AI workflows.ResponsibilitiesDesign and evaluate LLM-based applications, including RAG pipelines, agentic systems, and chat interfacesConduct LLM red-teaming, bias detection, and alignment testing using comparative and statistical analysis techniquesBuild and maintain automated evaluation frameworks for LLM outputs using embedding-based and prompt-based methodsDevelop interactive dashboards and visualizations using Power BI to communicate insights and model performance to stakeholdersIntegrate and test LLMs using OpenAI APIs, Databricks, and Azure AI ServicesCollaborate on the development of fine-tuning and pre-training pipelines for domain-specific use casesWork with Vector Databases (e.g., FAISS, MongoDB, Neo4j) to support RAG and semantic search capabilitiesParticipate in code reviews, documentation, and agile development cycles with the engineering teamSkillsMinimum 1 year of professional (non-academic) experience in data science, machine learning, or AI-related rolesStrong programming skills in Python and SQL; experience with JavaScript is a plusBachelor's or master's degree in computer science, Data Science, AI, or a related fieldHands-on experience with LLM evaluation, bias detection, or alignment researchProficiency in data visualization tools, especially Power BI (experience with Tableau or similar tools is a bonus)Familiarity with LangChain, RAG, Ollama, LLM fine-tuning, and embedding-based analysisExperience with cloud platforms such as Microsoft Azure and DatabricksKnowledge of databases including PostgreSQL, MongoDB, Neo4j, and FAISSStrong analytical thinking, attention to detail, and a passion for building responsible AI systemsBenefitsHealth, dental, mental health, vision, short- and long-term disability, life and AD&D insurance coverage, adoption/surrogacy and wellness benefits, and employee/family assistance plansVarious retirement savings plans (including pension and a global share ownership plan with employer matching contributions)Financial education and counseling resourcesGenerous paid time off program in Canada includes holidays, vacation, personal, and sick daysFull range of statutory leaves of absenceCompany OverviewManulife is a leading international financial services group that helps people make their decisions easier and lives better. It was founded in 1887, and is headquartered in Toronto, Ontario, CAN, with a workforce of 10001+ employees. Its website is http://www.manulife.com/.



Apply To This Job