[Remote] Senior Data Engineer
Note: The job is a remote job and is open to candidates in USA. LHH is seeking a Senior Data Engineer to work on their data systems and services, collaborating with other engineers to deliver critical projects for Platform Ventures. The role involves designing and developing data pipelines, data marts, and schemas to support data warehousing and analytical requirements.ResponsibilitiesDesign and implement scalable data Lakehouse architectures using AWS S3, Delta Lake, and RedshiftBuild and maintain high-performance data pipelines to ingest, transform, and curate large datasetsDefine best practices for data modeling, partitioning, and storage optimization in a Lakehouse/medallion environmentDevelop and maintain data cataloging and metadata management solutionsDevelop ETL/ELT pipelines using Python, PySpark, and AWS GlueBuild robust batch and streaming data pipelinesImplement transformation workflows using DBTOptimize performance for Spark workloads and Redshift queriesDesign and maintain workflow orchestration using Apache AirflowMonitor pipeline performance and implement alerting and failure recoveryImplement data validation, lineage, and monitoring frameworksMaintain data documentation and data catalog integrationEnsure data reliability, consistency, and security across platformsImplement CI/CD pipelines for data workflowsAutomate testing, deployment, and monitoring of data pipelinesUse infrastructure-as-code where possible to maintain reproducible environmentsWork closely with data consumers, analysts, and platform engineersSupport self-service analytics through well-structured datasets and semantic modelsSkillsMUST HAVE CURRENT AWS experience7+ years of data warehousing / OLAP experience7+ years multidimensional database architecture, data modeling, and design experience5+ years of SQL Experience3+ years of Python Experience2+ years of Redshift Experience2+ years of NoSQL ExperienceTeam and vendor partner managementClear understanding of principles and techniques of Web developmentExperience with AWS Glue, Lambda, Step Functions, and AirflowExperience with data ingression from APIsDimensional database architecture experienceFormal systems life cycle methodology experienceExperience implementing CI/CD pipelines for data workflowsExperience working with data catalogs and metadata managementAWS Data Warehouse operations experienceTableau, Quicksight, Looker, big data and Realtime BI experienceExperience with data streamingBenefitsFully remoteBenefits include 401K, Medial and Dental, and annual bonusCompany OverviewAt LHH, we believe work should be meaningful, fulfilling, and connected. It was founded in 1967, and is headquartered in Jacksonville, Florida, US, with a workforce of 10001+ employees. Its website is http://www.lhh.com.