[Remote] Lead Data Engineer
Note: The job is a remote job and is open to candidates in USA. IT Labs is an international software tech company specializing in high-performance and innovation. They are seeking an experienced Lead Data Engineer to support a client in the digital health space by designing and evolving their data platform, building scalable data pipelines, and ensuring the delivery of high-quality data for business decisions.ResponsibilitiesLead the design, development, and optimization of scalable data platforms and pipelinesDesign, build, and maintain production-grade ETL/ELT workflows for batch and near real-time data processingDrive the migration and modernization of data assets from BigQuery and other analytical platforms into SnowflakeDevelop robust integrations with enterprise applications, APIs, and external data providersBuild and optimize Snowflake data models, schemas, Snowpipe ingestion processes, and query performanceCollaborate with business stakeholders, analysts, and engineering teams to translate business requirements into scalable data solutionsImplement data quality, validation, monitoring, and observability frameworksEstablish and promote best practices for data governance, lineage tracking, metadata management, and securitySupport both batch and streaming data architectures using technologies such as Kafka, Event Hub, or equivalentMentor other engineers and contribute to architectural decisions, technical standards, and engineering best practicesEnsure data platforms meet performance, reliability, scalability, and regulatory requirementsSkills7+ years of experience in data engineering within cloud or hybrid environmentsStrong experience designing, building, and maintaining production-scale ETL/ELT pipelinesAdvanced SQL skills and proficiency with data transformation techniquesStrong Python programming skills for data processing and automationHands-on experience with Snowflake, including: Data modeling, Snowpipe, Query optimization, Schema designExperience migrating from BigQuery or similar columnar data warehouse technologiesExperience with batch and streaming data processing platforms such as Kafka, Event Hub, or equivalentExperience building enterprise-grade API and source-system integrationsExperience implementing data quality and validation frameworksGood understanding of: Data governance, Data lineage, Access control and security best practicesStrong problem-solving and communication skillsAbility to work effectively in a collaborative, cross-functional environmentExperience with Databricks, including: Delta Lake, Unity Catalog, Spark-based pipelinesExperience with Spark, Scala, or PySparkFamiliarity with TableauUnderstanding of HIPAA and HITRUST data handling practicesExperience with dbt (data build tool) for transformation layer managementExperience working within healthcare, insurance, or regulated industriesBenefitsFull-time, 40h/weekUS-based — US citizenship is requiredRemoteContract or B2B arrangementCompany OverviewCreating a Better Future, Together Founded in 2005 in Los Angeles, IT Labs brings skilled tech professionals together to develop high-performing software development teams. It was founded in 2005, and is headquartered in Palm Beach Gardens, Florida, USA, with a workforce of 201-500 employees. Its website is http://www.it-labs.com.