[Remote] 100% Remote - Data Engineer (Python, SQL, ADF, and Databricks) opportunity
Note: The job is a remote job and is open to candidates in USA. HYR Global Source Inc is seeking a skilled Data Engineer to join their team on a 12+ months remote opportunity. The ideal candidate will have strong hands-on experience building scalable data pipelines and working with modern cloud-based data platforms, focusing on data processing, automation, and performance optimization across large-scale data systems.
Responsibilities
ā¢ Design, develop, and maintain scalable ETL/data pipelines in cloud environments
ā¢ Build and manage both batch and real-time (streaming) data processing workflows
ā¢ Develop and optimize data transformations using Python, SQL, and Apache Spark
ā¢ Implement robust data solutions using Databricks and Azure Data Factory
ā¢ Ensure data pipeline reliability, scalability, and performance through monitoring and optimization
ā¢ Collaborate with cross-functional teams, including analysts, BI developers, and DevOps engineers
ā¢ Support reporting and analytics initiatives by enabling clean, well-structured datasets for BI tools
ā¢ Apply best practices in data quality, testing, version control, and CI/CD automation
Skills
ā¢ Programming: Python, SQL
ā¢ Data Processing: Apache Spark, Databricks, Azure Data Factory
ā¢ Streaming Technologies: Kafka, Google Pub/Sub (or similar messaging systems)
ā¢ DevOps & Automation: Git, Jenkins or GitHub Actions, Azure DevOps, Terraform, Docker
ā¢ Visualization & Reporting: Power BI, Tableau, or similar BI tools
ā¢ Experience with data lake and/or data warehouse architectures (e.g., Lakehouse concepts)
ā¢ Knowledge of data governance frameworks and data quality tools
ā¢ Familiarity with CI/CD pipelines and automated data testing best practices
Company Overview
ā¢ Established in 2013. At HYR Global Source Inc., we are your trusted technology partner, driving innovation through cutting-edge solutions. It was founded in 2013, and is headquartered in Overland Park, Kansas, USA, with a workforce of 51-200 employees. Its website is https://hyrglobalsource.com/.
Apply Now
Apply Now
Responsibilities
ā¢ Design, develop, and maintain scalable ETL/data pipelines in cloud environments
ā¢ Build and manage both batch and real-time (streaming) data processing workflows
ā¢ Develop and optimize data transformations using Python, SQL, and Apache Spark
ā¢ Implement robust data solutions using Databricks and Azure Data Factory
ā¢ Ensure data pipeline reliability, scalability, and performance through monitoring and optimization
ā¢ Collaborate with cross-functional teams, including analysts, BI developers, and DevOps engineers
ā¢ Support reporting and analytics initiatives by enabling clean, well-structured datasets for BI tools
ā¢ Apply best practices in data quality, testing, version control, and CI/CD automation
Skills
ā¢ Programming: Python, SQL
ā¢ Data Processing: Apache Spark, Databricks, Azure Data Factory
ā¢ Streaming Technologies: Kafka, Google Pub/Sub (or similar messaging systems)
ā¢ DevOps & Automation: Git, Jenkins or GitHub Actions, Azure DevOps, Terraform, Docker
ā¢ Visualization & Reporting: Power BI, Tableau, or similar BI tools
ā¢ Experience with data lake and/or data warehouse architectures (e.g., Lakehouse concepts)
ā¢ Knowledge of data governance frameworks and data quality tools
ā¢ Familiarity with CI/CD pipelines and automated data testing best practices
Company Overview
ā¢ Established in 2013. At HYR Global Source Inc., we are your trusted technology partner, driving innovation through cutting-edge solutions. It was founded in 2013, and is headquartered in Overland Park, Kansas, USA, with a workforce of 51-200 employees. Its website is https://hyrglobalsource.com/.
Apply Now
Apply Now