Data Pipeline Engineer
Description As a Big Data Architect Contractor, you will support the project team by designing and implementing large-scale data solutions to meet business needs. Design and develop scalable big data architectures to handle large volumes of data. Collaborate with stakeholders to understand data requirements and translate them into technical solutions. Implement data integration, data processing, and data storage solutions using big data technologies. Ensure data security, data quality, and data governance standards are met. Optimize data architectures for performance, scalability, and cost-efficiency. Primary Skill Required for the Role: Databricks Level Required for Primary Skill: Advanced (6-9 years experience) Additional Skills Requested for Role: • Microsoft - SQL Azure - Advanced (6-9 years experience) • Data Modeling - Advanced (6-9 years experience) • DATA ENGINEERING - Advanced (6-9 years experience) Additional Details for Role: Data Pipeline Engineer Skills: • Databricks (Python and SQL/PySpark) • Azure SQL Server (Managed Instance, Azure SQL DB, SQL Server VMs) • Data modeling and ETL/ELT design patterns • Docker and Azure Kubernetes Service (AKS) for select automation • Performance optimization and scalability Experience: • 7+ years enterprise data engineering • Healthcare data integration experience strongly preferred • Experience with large-scale data harmonization and normalization Job Type: Contract Pay: $55.00 - $62.00 per hour Expected hours: No less than 40 per week Benefits: • Referral program Application Question(s): • Are you comfortable working on W2? • Are you legally authorized to work in the United States, US Citizen/Green Card Holder? • Are you willing to work on a contract basis? • How many years of experience do you have with enterprise data engineering? • How many years of experience do you have with Healthcare data integration? • How many years of experience do you have with large-scale data harmonization and normalization? • How many years of experience do you have with Databricks? • How many years of experience do you have with Python and SQL/PySpark? • How many years of experience do you have with Azure SQL Server (Managed Instance, Azure SQL DB, SQL Server VMs)? • How many years of experience do you have with Docker and Azure Kubernetes Service (AKS)? Work Location: Remote Apply tot his job