AI Product Data Analyst
Description
At MEDvidi, we are transforming mental healthcare by making it more accessible and affordable across the United States. Our mission is to remove barriers to mental health support and ensure that everyone can access the care they need.
As our AI initiatives scale, high-quality analytics becomes a critical bottleneck - and this role is designed to solve it.
About the Role
We are hiring a Data Analyst to play a key role within the AI product team, ensuring data-driven accuracy in decision-making while evaluating, improving, and scaling AI-powered solutions in production.
This is a highly strategic, fast-paced role focused on measuring the real impact of AI agents and LLM-based systems, turning ambiguous problems and incomplete data into accurate decisions
Requirements
3+ years of hands-on experience as a Data Analyst working with product or platform data
Strong proficiency in Python for analytical work and ability to independently investigate data on the level of datapoints, build structural analyses, and present results
Confident SQL skills with experience working on complex queries
Experience building production-grade dashboards in BI tools, preferably in Tableau
Clear understanding of how LLM-based systems operate, including their limitations, failure modes, and trade-offs
Strong problem-solving and ownership mindset: you take responsibility for analytical outcomes, not just task execution
Ability to work in fast-changing, ambiguous environments and quickly learn new AI-related technologies
Proven experience linking product quality metrics to business impact and decision-making
Fluent Russian; English level B2 or higher
Ability to work CET-overlapping hours
Nice to Have
Experience evaluating or analyzing AI / ML / LLM products
Experience with dialog systems or conversational agents
Understanding of model quality metrics and evaluation approaches
Responsibilities
Analyze the performance and impact of AI initiatives already running in production
Develop and maintain dashboards that provide transparency into AI agent performance
Investigate issues, inconsistencies, and performance drops across automated user journeys
Design and implement evaluation approaches to measure system quality and user experience
Identify opportunities where automation improves outcomes, as well as areas where it introduces friction
Track adoption and effectiveness of automation across the product and support its further evolution
Partner closely with Product, Engineering, and QA teams to support data-informed decisions
Why Join Us
Work on a modern AI product where quality is a strategic function, not a formality
Real influence on product direction and engineering practices
High-impact work in a product-driven medical tech company
Startup environment: fast iteration, high ownership, minimal bureaucracy
Competitive compensation and growth opportunities
Benefits
Health insurance after probation period
Sports & wellness compensation
Fully remote, long-term B2B collaboration
19 working days of vacation per year
3 additional wellness days per year
Paid sick leave for the first 5 working days
Gifts to employees for important events
Career Development
Personalized English lessons via Preply
Ready to make an impact? Send us your profile - let’s build something meaningful together.
apply to this job
At MEDvidi, we are transforming mental healthcare by making it more accessible and affordable across the United States. Our mission is to remove barriers to mental health support and ensure that everyone can access the care they need.
As our AI initiatives scale, high-quality analytics becomes a critical bottleneck - and this role is designed to solve it.
About the Role
We are hiring a Data Analyst to play a key role within the AI product team, ensuring data-driven accuracy in decision-making while evaluating, improving, and scaling AI-powered solutions in production.
This is a highly strategic, fast-paced role focused on measuring the real impact of AI agents and LLM-based systems, turning ambiguous problems and incomplete data into accurate decisions
Requirements
3+ years of hands-on experience as a Data Analyst working with product or platform data
Strong proficiency in Python for analytical work and ability to independently investigate data on the level of datapoints, build structural analyses, and present results
Confident SQL skills with experience working on complex queries
Experience building production-grade dashboards in BI tools, preferably in Tableau
Clear understanding of how LLM-based systems operate, including their limitations, failure modes, and trade-offs
Strong problem-solving and ownership mindset: you take responsibility for analytical outcomes, not just task execution
Ability to work in fast-changing, ambiguous environments and quickly learn new AI-related technologies
Proven experience linking product quality metrics to business impact and decision-making
Fluent Russian; English level B2 or higher
Ability to work CET-overlapping hours
Nice to Have
Experience evaluating or analyzing AI / ML / LLM products
Experience with dialog systems or conversational agents
Understanding of model quality metrics and evaluation approaches
Responsibilities
Analyze the performance and impact of AI initiatives already running in production
Develop and maintain dashboards that provide transparency into AI agent performance
Investigate issues, inconsistencies, and performance drops across automated user journeys
Design and implement evaluation approaches to measure system quality and user experience
Identify opportunities where automation improves outcomes, as well as areas where it introduces friction
Track adoption and effectiveness of automation across the product and support its further evolution
Partner closely with Product, Engineering, and QA teams to support data-informed decisions
Why Join Us
Work on a modern AI product where quality is a strategic function, not a formality
Real influence on product direction and engineering practices
High-impact work in a product-driven medical tech company
Startup environment: fast iteration, high ownership, minimal bureaucracy
Competitive compensation and growth opportunities
Benefits
Health insurance after probation period
Sports & wellness compensation
Fully remote, long-term B2B collaboration
19 working days of vacation per year
3 additional wellness days per year
Paid sick leave for the first 5 working days
Gifts to employees for important events
Career Development
Personalized English lessons via Preply
Ready to make an impact? Send us your profile - let’s build something meaningful together.
apply to this job