[Remote] Data Engineering with Python

Note: The job is a remote job and is open to candidates in USA. Diverse Lynx is seeking a Data Engineer with strong expertise in Python-based data engineering and CI/CD automation using GitHub Actions. The candidate will play a critical role in building scalable data pipelines, automating deployments, and enabling high-quality data delivery across cloud platforms.ResponsibilitiesDesign, build, and maintain scalable data pipelines using PythonDevelop ETL/ELT workflows for batch and near real-time data processingWork with structured and unstructured data across cloud/platform ecosystemsImplement data transformation, validation, and quality frameworksBuild and maintain CI/CD pipelines using GitHub Actions to automate: Code builds and validations, Unit/integration testing, Deployment of data pipelines and servicesImplement branching strategies, code reviews, and version control using GitEnable automated testing and release management for data workflowsIntegrate CI/CD pipelines with cloud platforms and data servicesSkillsStrong expertise in Python-based data engineeringCI/CD automation using GitHub ActionsBuilding scalable data pipelinesAutomating deploymentsEnabling high-quality data delivery across cloud platformsDesigning, building, and maintaining scalable data pipelines using PythonDeveloping ETL/ELT workflows for batch and near real-time data processingWorking with structured and unstructured data across cloud/platform ecosystemsImplementing data transformation, validation, and quality frameworksBuilding and maintaining CI/CD pipelines using GitHub ActionsAutomating code builds and validationsUnit/integration testingDeployment of data pipelines and servicesImplementing branching strategies, code reviews, and version control using GitEnabling automated testing and release management for data workflowsIntegrating CI/CD pipelines with cloud platforms and data servicesCompany OverviewDiverse Lynx is a WBENC- and NMSDC-certified partner, helping organizations turn diversity goals into measurable impact through staffing and contingent workforce solutions. It was founded in 2002, and is headquartered in Princeton, New Jersey, US, with a workforce of 1001-5000 employees. Its website is http://www.diverselynx.com.Company H1B SponsorshipDiverse Lynx has a track record of offering H1B sponsorships, with 1 in 2024, 1 in 2021. Please note that this does not guarantee sponsorship for this specific role.