[Remote] Senior Data Engineer
Note: The job is a remote job and is open to candidates in USA. Foundation Partners Group is dedicated to providing compassionate funeral, cremation, and cemetery services. They are seeking a Senior Data Engineer to design and build modern data platforms using Azure and AWS, focusing on scalable data pipelines and containerized workload execution.ResponsibilitiesDesign and build scalable data pipelines using Python and cloud-native orchestration tools, including Azure Data Factory, Azure Container Apps Jobs, and Fabric Data PipelinesArchitect data solutions across Microsoft Fabric Warehouses, Azure SQL Database, and AWS (S3, Redshift), selecting the right tool for the workloadImplement Medallion/layered architecture patterns (Bronze to Silver to Gold) for structured, governed data deliveryManage and optimize large-scale data warehouse environments with a focus on performance, cost, and maintainabilityDevelop Python-based ETL/ELT pipelines to ingest and transform data from APIs, flat files, databases, and SaaS platformsBuild and deploy containerized pipeline jobs using Azure Container Apps Jobs, including scheduling, scaling rules, secrets management via Azure Key Vault, and integration with Azure Container RegistryBuild and maintain data movement between on-premises SQL Server environments and cloud targetsDesign idempotent, fault-tolerant pipeline patterns with robust logging, alerting, and retry logicCollaborate with analytics and reporting teams to deliver clean, well-documented data models for Power BI or similar BI toolsManage data infrastructure across Azure (Fabric, Azure SQL, Azure Data Lake, Key Vault, Container Apps, Container Registry) and AWS (S3, EC2, RDS/Redshift)Containerize data workloads using Docker; deploy and operate them as Azure Container Apps Jobs for scheduled batch processing and event-triggered pipeline executionImplement infrastructure-as-code principles and version-controlled deployment practices using GitHub, Bicep or Terraform, and CI/CD tooling (Azure DevOps or GitHub Actions)Monitor platform health, optimize compute and storage costs, and enforce data security and access governancePartner with data analysts, BI developers, software engineers, and business stakeholders to translate requirements into technical solutionsMaintain thorough technical documentation: pipeline specs, data dictionaries, runbooks, and architecture diagramsChampion engineering best practices: code reviews, testing, modular design, and reusable frameworksMentor junior engineers and contribute to team standards and knowledge sharingSkillsPython: fluent in writing production-grade pipelines, data transformations, and automation scriptsRDBMS: Advanced T-SQL and/or ANSI SQL; experience with SQL Server, Azure SQL DB, and cloud warehouse query engines (Redshift, Fabric)MS Fabric: Warehouses, Lakehouses, Data Pipelines, OneLake, and Fabric's unified analytics modelAzure ecosystem: Azure Data Factory, Azure SQL Database, Azure Data Lake Storage, Azure Key Vault, Azure Container Apps Jobs, Azure Container Registry, and related servicesContainerization: Docker image development, container registry management, and deploying workloads as Container Apps Jobs with schedule and event triggers, scaling rules, and environment variable/secret injectionAWS data services: S3 for data lake storage, Redshift for cloud data warehousingData modeling: dimensional modeling, star/snowflake schema design, and entity-relationship modeling for both OLTP and OLAP workloadsVersion control and DevOps: Git, GitHub, pull request workflows, and CI/CD pipelinesData Visualization: Power BI, TableauStrong analytical problem-solving -- able to decompose ambiguous business problems into clean technical solutionsClear written and verbal communication with both technical peers and non-technical stakeholdersSelf-directed with strong attention to detail; comfortable owning work end-to-end5 to 8 years of hands-on data engineering experience in production environmentsProven track record designing and delivering data platforms on Azure and/or AWSDemonstrated experience migrating or modernizing legacy on-premises data infrastructure to cloud-native solutionsHands-on experience running workloads with Azure Container Apps Jobs or a comparable containerized job execution platformExperience with MS Fabric in a production capacity, including Fabric Warehouses and OneLake integrationFamiliarity with dbt (data build tool) or similar transformation frameworksExposure to streaming or near-real-time data ingestion patterns (Event Hub, Kafka, Kinesis)Experience with Workday, Adaptive Planning, or other ERP/FP&A source systemsPower BI experience including semantic model development, dataset optimization, or DirectQuery/Import mode tradeoffsAgile/Scrum team experience; comfort working in iterative delivery cyclesRelevant cloud certifications: Microsoft Azure Data Engineer (DP-203), AWS Certified Data Analytics, or equivalentBachelor's degree in Computer Science, Information Systems, Data Science or a related field. In lieu of formal education, equivalent professional experience demonstrating the same depth of knowledge is acceptedBenefitsMedical, dental, prescription, and vision coverageGenerous paid time off, including vacation, sick time, and holidays401(k) with company matchCompany-paid life insurance, short-term disability, and long-term disabilityCompany OverviewFoundation Partners Group is a portfolio company that owns and operates funeral homes and cemeteries. It was founded in 2010, and is headquartered in Orlando, Florida, USA, with a workforce of 1001-5000 employees. Its website is http://www.foundationpartners.com.