Sr. Data Engineer - Databricks/dbt
Job Summary
We are seeking a highly skilled and motivated Sr. Data Engineer to join our dynamic team. The ideal candidate will have extensive experience developing on Databricks with a dbt transformation layer.
Duties
ā¢ Work in all areas of Databricks including ingestion, transformations and data modeling within Azure Databricks.
ā¢ Create silver (transformation) and gold (mart) layer models using dbt on Databricks.
ā¢ Develop models in conformance with industry and customer standards
ā¢ Perform testing/QA on models to ensure accuracy and performance
ā¢ Work within the customer's CI/CD framework
ā¢ Troubleshoot complex technical issues and provide effective solutions.
ā¢ Document processes, technical specifications, and project updates for internal use.
ā¢ Support the finance and marketing teams or others as assigned.
ā¢ Migrate existing data sets from legacy systems into Databricks.
Experience
ā¢ Strong SQL, dbt and databricks skills
ā¢ 3+ Years of strong dbt experience including dbt core, dbt elementary, dbt loom
ā¢ Extensive experience calling REST APIs including performance tuning, pagination etc.
ā¢ Excellent problem-solving skills with a keen attention to detail.
ā¢ Strong interpersonal skills with the ability to communicate complex ideas clearly to diverse audiences.
ā¢ Experience being the key contributor/SME for a specific data set and reporting area
ā¢ Proven experience in a technical leadership role within the field of Data Analytics, Data Warehousing with a focus in dbt, Databricks and Power BI
ā¢ 6+ Years of Databricks/PySpark experience
ā¢ 10+ Years of software development with proficiency in SQL, Python, PySpark, GITHUB, VS Code
ā¢ A degree in Computer Science, Engineering, or a related field is preferred.
Type of Role: Contract
Duration: 6 Months + possibility of extension
Pay: $70.00 - $80.00 per hour
Application Question(s):
ā¢ REST API programming
Experience:
ā¢ Python: 6 years (Required)
ā¢ SQL: 6 years (Required)
ā¢ Data analytics: 10 years (Required)
ā¢ dbt - Data Build Tool: 3 years (Required)
Work Location: Remote
Apply tot his job
Apply To this Job
We are seeking a highly skilled and motivated Sr. Data Engineer to join our dynamic team. The ideal candidate will have extensive experience developing on Databricks with a dbt transformation layer.
Duties
ā¢ Work in all areas of Databricks including ingestion, transformations and data modeling within Azure Databricks.
ā¢ Create silver (transformation) and gold (mart) layer models using dbt on Databricks.
ā¢ Develop models in conformance with industry and customer standards
ā¢ Perform testing/QA on models to ensure accuracy and performance
ā¢ Work within the customer's CI/CD framework
ā¢ Troubleshoot complex technical issues and provide effective solutions.
ā¢ Document processes, technical specifications, and project updates for internal use.
ā¢ Support the finance and marketing teams or others as assigned.
ā¢ Migrate existing data sets from legacy systems into Databricks.
Experience
ā¢ Strong SQL, dbt and databricks skills
ā¢ 3+ Years of strong dbt experience including dbt core, dbt elementary, dbt loom
ā¢ Extensive experience calling REST APIs including performance tuning, pagination etc.
ā¢ Excellent problem-solving skills with a keen attention to detail.
ā¢ Strong interpersonal skills with the ability to communicate complex ideas clearly to diverse audiences.
ā¢ Experience being the key contributor/SME for a specific data set and reporting area
ā¢ Proven experience in a technical leadership role within the field of Data Analytics, Data Warehousing with a focus in dbt, Databricks and Power BI
ā¢ 6+ Years of Databricks/PySpark experience
ā¢ 10+ Years of software development with proficiency in SQL, Python, PySpark, GITHUB, VS Code
ā¢ A degree in Computer Science, Engineering, or a related field is preferred.
Type of Role: Contract
Duration: 6 Months + possibility of extension
Pay: $70.00 - $80.00 per hour
Application Question(s):
ā¢ REST API programming
Experience:
ā¢ Python: 6 years (Required)
ā¢ SQL: 6 years (Required)
ā¢ Data analytics: 10 years (Required)
ā¢ dbt - Data Build Tool: 3 years (Required)
Work Location: Remote
Apply tot his job
Apply To this Job