[Remote] SENIOR DATA ENGINEER-REMOTE

Note: The job is a remote job and is open to candidates in USA. Foodbuy USA, operating under CDAI, is a data and artificial intelligence engine of Compass Group North America focused on delivering tailored solutions for the food service and hospitality sectors. They are seeking a hands-on Master Data Management (MDM) Data Engineer to design and implement scalable data architectures and solutions on AWS, collaborating with various teams to manage data pipelines and build APIs for analytics and reporting.ResponsibilitiesDesign, develop, and deploy scalable and secure data pipelines and cloud-native architectures (data lakes, warehouses, and streaming pipelines) on AWSBuild and maintain ETL/ELT workflows using AWS Glue, Lambda, and Python to support a variety of data integration needsDevelop, deploy, and optimize APIs to enable seamless data access for business intelligence, analytics, and operational systemsAnalyze, debug, and resolve data quality issues and pipeline failures to ensure data accuracy and reliabilityCollaborate across teams—including data science, analytics, and software engineering—to design and implement reusable data modelsEnsure efficient, scalable, and secure serverless operations through performance tuning and best practices in AWS environmentsCreate and maintain documentation, architecture diagrams, and data flow maps for internal and external useImplement and manage data governance, security protocols, compliance standards, and privacy best practicesIncorporate AI tools, such as ChatGPT, to streamline engineering tasks, documentation, and data explorationLead integration efforts with third-party APIs and data sources to expand the organization’s data capabilitiesEstablish and enforce architectural best practices, CI/CD pipelines, and Infrastructure as Code (IaC) in collaboration with DevOps teamsMentor team members, stay current with AWS innovations, and champion modern data practices across the organizationSkillsBachelor's degree in computer science, Information Systems, Analytics, or related field5+ years of experience in data architecture, engineering, or similar roles3+ years of hands-on programming experience with Python3+ years of experience building and managing ETL/ELT data pipelinesStrong SQL skills and ability to write performant queries across various data storesProficient with AWS services: Lambda, Glue, S3, DynamoDB, Athena, Redshift, and SnowflakeSolid understanding of OLTP, ODS, and dimensional modeling techniquesExperience designing APIs and integrating with API-driven data workflowsStrong knowledge of serverless architecture patterns and best practicesExcellent problem-solving, analytical, and communication skillsExperience in agile development environments with CI/CD workflowsAbility to collaborate across engineering, data, and business teamsAWS Certifications (e.g., AWS Solutions Architect)Experience with modern data stack tools such as dbt, Snowflake, DatabricksFamiliarity with machine learning pipelines and AI-driven analyticsExperience with Infrastructure as Code (IaC) tools like Terraform or AWS CloudFormationBackground in DevOps and automated deployment strategies for data workflowsExperience integrating with ServiceNow applicationBenefitsMedicalDentalVisionLife Insurance/ ADDisability InsuranceRetirement PlanPaid Time OffHoliday Time Off (varies by site/state)Associate Shopping ProgramHealth and Wellness ProgramsDiscount MarketplaceIdentity Theft ProtectionPet InsuranceCommuter BenefitsEmployee Assistance ProgramFlexible Spending Accounts (FSAs)Paid Parental LeavePersonal LeaveAssociates may also be eligible for paid and/or unpaid time off benefits in accordance with applicable federal, state, and local laws. For positions in Washington State, Maryland, or to be performed Remotely, [click here](https://www.compass-usa.com/wp-content/uploads/2023/08/2023_WageTransparency_CorpAndFoodbuy.pdf) or copy/paste the link below for paid time off benefits information.Company OverviewFoodbuy, LLC is the foodservice industry’s leading procurement services organization focused on lowering purchasing and product costs for both our parent company, Compass Group, as well as for our clients and members. It was founded in 1999, and is headquartered in Charlotte, NC, US, with a workforce of 501-1000 employees. Its website is http://www.foodbuy.com.