[Remote] Sr. Principal Data Engineer / Data Architect

Note: The job is a remote job and is open to candidates in USA. Digital Remedy is a performance media partner for agencies, brands, and media companies. As the Sr. Principal Data Engineer, you will architect the next-generation data platform, ensuring scalable and resilient integrations while overseeing data lakehouse architecture and managing production excellence.ResponsibilitiesArchitectural Leadership: Design and oversee the migration/optimization of our data lakehouse architecture using DatabricksProduction Excellence: Serve as the escalation point for the platform, leveraging a proven record of handling production issues to ensure 24/7 reliability of mission-critical pipelinesStrategic Capacity Planning: Work directly with the SVP of Tech to translate product roadmaps into technical requirements. This requires the ability to multi-task across various high-priority workstreams without losing sight of architectural integrityInfrastructure as Code: Drive the adoption of Databricks Asset Bundles (DABs) to standardize deployments across dev, staging, and productionMentorship & Governance: Provide high-level guidance to engineering squads in India and the US, defining schemas and governance models for BigQuery and DatabricksWork with engineers across multiple geographies and time zonesSkillsExpert-Level Databricks: Minimum 4+ years of hands-on experience specifically within the Databricks ecosystem (Delta Lake, Unity Catalog, Photon)The Stack: Deep proficiency in Spark (PySpark/Scala), Python, and SQL. Experience with GCP (BigQuery) is a major plusScale: Proven experience managing petabyte-scale datasets and high-concurrency pipelines (AdTech experience preferred)Independent Execution: Must be a self-starter capable of taking a high-level concept from the SVP and driving it to completion with minimal supervisionExperience: 10+ years in Data Engineering, with at least 3 years in a Principal or Architect capacityIncident Management: A history of successfully diagnosing and resolving complex, large-scale production bottlenecks and data outagesContext Switching: A demonstrated ability to multi-task, balancing long-term architectural R&D with immediate business requests and partner integrationsFinOps & Communication: Strong understanding of optimizing Databricks/BigQuery costs and the ability to communicate technical trade-offs to non-technical stakeholdersBenefitsParticipation in a retirement planQuarterly and annual incentive plan bonusesLife and disability insuranceHealth, dental and vision plansFlexible spending accounts15 paid vacation days2 paid personal days9 paid holidays40 hours of paid sick leaveParental leaveEmployee stock purchase planCompany OverviewDigital Remedy is a digital media solutions company leading the tech-enabled marketing space. It was founded in 2000, and is headquartered in New York, New York, USA, with a workforce of 51-200 employees. Its website is http://www.digitalremedy.com/.