[Remote] Manager, Data Engineering Operations

Note: The job is a remote job and is open to candidates in USA. New York Oncology Hematology is part of OneOncology, which focuses on enhancing medical care through a patient-centric model. The Manager, Data Engineering Operations will lead a team responsible for the operational health of the data platform, ensuring reliability and performance while collaborating with cross-functional teams.ResponsibilitiesLead, mentor, and develop engineers on the Data Operations team, including hiring, performance management, and career development as neededSet clear goals, deliver regular feedback, and create growth opportunities for each team memberFoster a collaborative, high-accountability team culture focused on quality, continuous improvement, and operational efficiencyManage team capacity, workload, and prioritization across competing demandsOwn incident management and resolution for pipeline failures, cluster issues, and data quality problems, driving thorough root cause analysis and lasting preventative improvementsDefine and enforce operational standards, runbooks, and on-call practices for the teamManage and maintain Databricks Workflows and job orchestration, ensuring SLAs are consistently metEstablish and report on operational KPIs (uptime, pipeline reliability, incident response, cost) to leadership and stakeholdersSet technical direction for the data platform in partnership with senior engineering leadershipDrive platform reliability, performance, and cost-efficiency initiativesPartner with IT, Security, and Engineering teams on platform architecture, governance, and integration decisionsChampion engineering best practices including code review, testing, observability, and documentationServe as the primary point of contact for data platform operations across the businessCommunicate operational status, risks, and roadmap clearly to both technical and non-technical audiencesBuild strong working relationships with downstream consumers, ensuring the platform meets their needsAdditional responsibilities as assigned to help drive our mission of improving the lives of everyone living with cancerSkills8+ years of hands-on data engineering experience, with at least 2 years in a leadership or management roleStrong hands-on background with SQL development and relational/non-relational databases, including data modeling, schema design, and query optimizationProfessional experience developing scalable solutions in Python or a similar object-oriented languageProficiency in Databricks, Spark, and Delta tables; experience operating large-scale distributed data processing in productionDemonstrated experience operating and monitoring data pipelines at scale, including incident response and on-call leadershipSolid understanding of Lakehouse and Medallion architecturesExperience with Azure data services (ADLS Gen2, Azure Data Factory, Event Hubs, or equivalent)Familiarity with Unity Catalog for data governance, access control, and data lineageProven experience designing and maintaining data integration/ETL pipelines using Azure Data Factory or equivalentExcellent communication and organizational skills, with a track record of conveying technical concepts and operational status to diverse audiencesAbility to drive alignment and influence decisions across cross-functional stakeholdersExperience hiring, developing, and retaining engineering talentStrong operational ownership mindset with a focus on reliability, scalability, and continuous improvementLeadership ability to set technical direction while balancing business priorities and team executionEffective decision-making and prioritization in fast-paced, production-focused environmentsAttendance is an essential job functionCompany OverviewNew York Oncology Hematology is the largest cancer and blood condition treatment center in the United States. It was founded in 1985, and is headquartered in Albany, New York, USA, with a workforce of 501-1000 employees. Its website is https://newyorkoncology.com/.