Sr. Principal Consultant (Senior Data Engineer, Compliance Engineering & Technology)
Sr. Principal Consultant (Senior Data Engineer, Compliance Engineering & Technology) 3 resources Subcontracting roles Location: Remote & (US-PST time zone) Responsibilities Resources should have experience with AML & KYC. • Work with engineering and product teams to design, develop, and manage scalable ETL pipelines to unblock new product launches. • Create brand new and optimize existing data models and schemas on top of Block data including but not limited to eventing, customer level, and process level data. • Build monitoring to assess the health of the team's infrastructure as well as data quality and lineage. • Participate in on-call rotation, monitor daily execution, diagnose and log issues, and fix business critical pipelines to ensure SLAs are met with internal stakeholders • Work with non-technical partners and product teams to understand their needs, translate business requirements into applicable data requirements, and come up with automated end-to-end solutions. • Standardize business and product metric definitions in curated and optimized datasets and develop data dictionaries and other related documentation. • Teach and encourage others to self-serve by building tools that make it simpler and faster for them to do so. • Should have experience working on below technology • Snowflake • Databricks • Dbt • Github • Airflow • Prefect • Tableau Qualifications we seek in you! Minimum Qualifications / Skills • B.E/B.TECH/ Any Graduation Equivalent Preferred Qualifications/ Skills • A minimum of 8 years of related experience with a bachelor's degree; or 6 years and a master's degree; or equivalent experience. • High proficiency in SQL • Working experience with Python, and Terraform • Experience designing medium-to-large data engineering solutions and responsible for the entire lifecycle of projects including scoping, design, development, testing, deployment, and documentation • Experience with ETL scheduling technologies with dependency checking, such as Airflow or Prefect, as well as schema design and dimensional data modeling • Experience with setting up data quality and data lineage monitoring • Experience with financial crimes compliance systems, technologies, and processes is a big plus • Experience driving data-driven decisions for AI initiatives / agent building is a big plus Apply tot his job