Senior Data Engineer
Job title: Senior Data Engineer in Iselin, NJ at Brains Workgroup
Company: Brains Workgroup
Job description: Our client, a major bank in Central, NJ, is looking for Senior Data Engineer.
Hybrid commute, 2 days on-site in Central NJ Locations and 3 day remote per week.This is a permanent FT career opportunity, with base salary range 170 - 190K DOE, plus around 20% bonus and great benefits package.Looking for Senior Data Engineer in banking/financial industry.Major Responsibilities:
Building and maintaining data pipelines to ingest data from source systems into Databricks
Designing, Building and maintaining generic frameworks to ingest data through the medallion layers
Working with the core data platform team to integrate the framework with reference architecture
Assisting the data mesh teams with best practices and on-boarding to the new framework
Requirements:
10+ years of data engineering experience in building OLTP and OLAP databases, both on-prem and in the cloud
5+ years of experience with large scale data processing using SQL, Python, Pandas and Pyspark
5+ years of experience building robust and scalable data pipelines in Databricks Lakehouse platform on any key cloud platform provider, preferably Azure cloud
Experience with implementing Medallion architecture for data processing
Experience with implementing Streaming data ingestion using Kafka
Test driven development experience
Proven experience in solution design and applying best design practices
Data modeling and ER/UML diagram skills
Experience with orchestration/enterprise scheduler platforms like Airflow, Tidal etc..
Experience with implementing API based data integration pipelines
Experience with source control and DevOps for CI/CD
Experience working in Agile/scrum methodologies
Experience with Jira, confluence for project work and documentation
Experience with Service now for incident management
Finance domain knowledge in Investment Banking (Securities, Capital markets) and Security reference data knowledge
Nice to have ADF and SSIS experience
College degree required.
Please email your resume or use this link to apply directly:Or email:
Check ALL our Jobs:Keywords: sql oracle python databricks etl data warehousing ssis ETL snow numpy pandas pyspark oltp olap
Expected salary:
Location: Iselin, NJ
Apply for the job now!
Apply Now
Company: Brains Workgroup
Job description: Our client, a major bank in Central, NJ, is looking for Senior Data Engineer.
Hybrid commute, 2 days on-site in Central NJ Locations and 3 day remote per week.This is a permanent FT career opportunity, with base salary range 170 - 190K DOE, plus around 20% bonus and great benefits package.Looking for Senior Data Engineer in banking/financial industry.Major Responsibilities:
Building and maintaining data pipelines to ingest data from source systems into Databricks
Designing, Building and maintaining generic frameworks to ingest data through the medallion layers
Working with the core data platform team to integrate the framework with reference architecture
Assisting the data mesh teams with best practices and on-boarding to the new framework
Requirements:
10+ years of data engineering experience in building OLTP and OLAP databases, both on-prem and in the cloud
5+ years of experience with large scale data processing using SQL, Python, Pandas and Pyspark
5+ years of experience building robust and scalable data pipelines in Databricks Lakehouse platform on any key cloud platform provider, preferably Azure cloud
Experience with implementing Medallion architecture for data processing
Experience with implementing Streaming data ingestion using Kafka
Test driven development experience
Proven experience in solution design and applying best design practices
Data modeling and ER/UML diagram skills
Experience with orchestration/enterprise scheduler platforms like Airflow, Tidal etc..
Experience with implementing API based data integration pipelines
Experience with source control and DevOps for CI/CD
Experience working in Agile/scrum methodologies
Experience with Jira, confluence for project work and documentation
Experience with Service now for incident management
Finance domain knowledge in Investment Banking (Securities, Capital markets) and Security reference data knowledge
Nice to have ADF and SSIS experience
College degree required.
Please email your resume or use this link to apply directly:Or email:
Check ALL our Jobs:Keywords: sql oracle python databricks etl data warehousing ssis ETL snow numpy pandas pyspark oltp olap
Expected salary:
Location: Iselin, NJ
Apply for the job now!
Apply Now