Associate Data Scientist

Manulife is a leading international financial services provider, helping people make their decisions easier and lives better. The Associate Data Scientist role offers an exciting opportunity to design, evaluate, and deploy LLM-based applications, contributing to the development of responsible and impactful AI solutions while gaining real-world experience in LLM evaluation and enterprise AI workflows. Responsibilities Design and evaluate LLM-based applications, including RAG pipelines, agentic systems, and chat interfaces Conduct LLM red-teaming, bias detection, and alignment testing using comparative and statistical analysis techniques Build and maintain automated evaluation frameworks for LLM outputs using embedding-based and prompt-based methods Develop interactive dashboards and visualizations using Power BI to communicate insights and model performance to stakeholders Integrate and test LLMs using OpenAI APIs, Databricks, and Azure AI Services Collaborate on the development of fine-tuning and pre-training pipelines for domain-specific use cases Work with Vector Databases (e.g., FAISS, MongoDB, Neo4j) to support RAG and semantic search capabilities Participate in code reviews, documentation, and agile development cycles with the engineering team Skills Minimum 1 year of professional (non-academic) experience in data science, machine learning, or AI-related roles Strong programming skills in Python and SQL; experience with JavaScript is a plus Bachelor's or master's degree in computer science, Data Science, AI, or a related field Hands-on experience with LLM evaluation, bias detection, or alignment research Proficiency in data visualization tools, especially Power BI (experience with Tableau or similar tools is a bonus) Familiarity with LangChain, RAG, Ollama, LLM fine-tuning, and embedding-based analysis Experience with cloud platforms such as Microsoft Azure and Databricks Knowledge of databases including PostgreSQL, MongoDB, Neo4j, and FAISS Strong analytical thinking, attention to detail, and a passion for building responsible AI systems Benefits Health, dental, mental health, vision, short- and long-term disability, life and AD&D insurance coverage, adoption/surrogacy and wellness benefits, and employee/family assistance plans Various retirement savings plans (including pension and a global share ownership plan with employer matching contributions) Financial education and counseling resources Generous paid time off program in Canada includes holidays, vacation, personal, and sick days Full range of statutory leaves of absence Company Overview Manulife is a leading international financial services group that helps people make their decisions easier and lives better. It was founded in 1887, and is headquartered in Toronto, Ontario, CAN, with a workforce of 10001+ employees. Its website is