[Remote] Lead Data Engineer

Note: The job is a remote job and is open to candidates in USA. Cushman & Wakefield is a global leader in real estate services, and they are seeking a Lead Data Engineer to architect and develop enterprise-scale data platforms and advanced analytics solutions. This role involves leading a team, optimizing data pipelines, and driving innovation in data engineering practices.ResponsibilitiesSupport the Solution and Data Architect(s) to help lead the design, development, and optimization of scalable data platforms and analytics solutions that support global data strategyArchitect and implement robust, scalable, metadata-driven pipelines in Databricks using Delta Lake, Unity Catalog, and declarative workflowsOversee the development and maintenance of Azure SQL database objects using advanced T-SQL for data quality and insight generationDrive performance, reliability and observability of real-time data processing using Spark Structured Streaming and Change Data Feed strategiesOwn CI/CD processes and infrastructure automation using Databricks Asset Bundles, Azure DevOps, and Infrastructure as CodeDefine and enforce standards for reusable, metadata-driven integration patterns, including Unity Catalog governance, Declarative Pipeline design, and data quality across the engineering teamManage and mentor a small team of data engineers, providing technical leadership, pair programming support, conducting design/code reviews, guiding technical decisions and aligning data engineering efforts with strategic goalsCollaborate with cross-functional stakeholders to translate business and technical requirements into scalable data solutions, assisting the project delivery team to scope, plan and deliver new and enhanced data integrationsChampion innovation, best practices, and continuous improvement in data engineering, while mentoring team members and fostering technical growthEvaluate and introduce emerging technologies to enhance platform capabilitiesSkillsExtensive hands-on experience (6+ years) in cloud-native data engineering, including 3+ years with Databricks and Delta Lake in Azure, combined with good (2+ years) in a technical leadership or architecture roleDeep practical experience of the Databricks ecosystem including Delta Lake, Unity Catalog, Declarative Pipelines, Spark Structured Streaming, Change Data Feed, Serverless SQL, and Cluster management & optimizationExpert-level SQL skills, with a track record of designing performant queries, optimizing data models, and driving insight generation from large datasetsProficiency in multiple programming languages used in data engineering and analytics (e.g., PySpark, Scala, R, Python), with experience mentoring others in their useDeep understanding of cloud-native data architecture, including Lakehouse design principles, data integration patterns, and automation strategiesProven ability to design and deliver scalable, production-grade data pipelines, with a focus on reliability, maintainability, and performanceStrong experience with CI/CD, version control (Git), ideally including Databricks Asset Bundles, and Infrastructure as Code, leading DevOps practices in data engineering teamsSkilled in requirements gathering and solution design, translating business needs into technical specifications and guiding teams through deliveryDemonstrated leadership in troubleshooting and resolving complex data and code issues, driving root cause analysis and long-term fixesExcellent communication and stakeholder engagement skills, with experience presenting architectural decisions, documenting processes, and influencing cross-functional teamsCommitment to continuous improvement, staying current with emerging technologies and fostering a culture of learning and innovation within the teamHands-on experience with machine learning pipelines or integrating data engineering with advanced analytics and AI workflowsExperience designing and implementing data mesh or domain-oriented data architectures in large-scale environmentsTest-driven development using common testing frameworks (e.g. pytest, nUnit, tSQLt, nBI, etc.)Exposure to real-time integrations or IoT solutions e.g. Event Hubs, Service Bus, IoT and Event Grid in Azure; IoT Core, PubSub in Google Cloud; etcFamiliarity with data governance frameworks, including data lineage, cataloging, and compliance (e.g., GDPR, HIPAA)Background in delivering data-driven solutions for commercial real estate applicationsDegree in IT, Engineering, computer sciences, business IT degree or in any quantitative disciplineBenefitsHealth, vision, and dental insuranceFlexible spending accountsHealth savings accountsRetirement savings plansLife, and disability insurance programsPaid and unpaid time away from workCompany OverviewCushman & Wakefield is a real estate services firm that offers retail investment, energy management, and property services. It was founded in 1917, and is headquartered in Chicago, Illinois, USA, with a workforce of 10001+ employees. Its website is https://www.cushmanwakefield.com.Company H1B SponsorshipCushman & Wakefield has a track record of offering H1B sponsorships, with 2 in 2026, 3 in 2025, 6 in 2024, 2 in 2023, 6 in 2022, 1 in 2021, 2 in 2020. Please note that this does not guarantee sponsorship for this specific role.