[Remote] Senior Data Architect
Note: The job is a remote job and is open to candidates in USA. Onix is a trusted cloud consulting company that helps companies get the most out of their technology with cloud-powered solutions. They are seeking an experienced Senior Data Architect/Principal Data Engineer to design and implement data solutions that meet client business needs and support overall cloud data architecture.
Responsibilities
ā¢ Lead the Design, development, and implementing of Lakehouse & data warehouses architecture in a cloud based data environment that integrates with an overall data architecture
ā¢ Work closely with business stakeholders to interpret their data needs and translate them into technical requirements
ā¢ Have a good understanding of data governance and develop & implement data governance policies and procedures
ā¢ Ensure data quality and integrity by implementing data testing and validation processes
ā¢ Deploying and debugging cloud data initiatives as needed in accordance with best practices throughout the development lifecycle
ā¢ Managing cloud data environments in accordance with company security guidelines
ā¢ Lead the design and build of reusable, repeatable solutions and components for future use
ā¢ Lead and mentor a team of data engineers to implement your solution designs
ā¢ Stay abreast of current and emerging trends and technologies in the data and AI/ML field
ā¢ Educate delivery teams on the implementation of new cloud-based data analytics initiatives, providing associated training as required
ā¢ Partner with Delivery, and Support teams to find opportunities to reduce manual effort needed to complete deployments
ā¢ Consult on Professional Services Engagements to help our customers design and implement data warehouse solutions
ā¢ Lead and develop best practices for the larger data analytics delivery team
ā¢ Provide client presentations to review project design, outcomes and recommendations
ā¢ Employ exceptional problem-solving skills, with the ability to see and solve issues before they snowball into problems
ā¢ Lead the orchestration and automation cloud-based data platforms
Skills
ā¢ 7+ years experience in Data Architecture, data engineering & analytics in areas such as performance tuning, pipeline integration & infrastructure configuration
ā¢ 10+ years of consulting experience
ā¢ Completed Databricks Data Engineering Professional/Associate certification OR Cloud Certification (Azure, AWS, GCP)
ā¢ Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with deep expertise in at least one
ā¢ Deep experience with distributed computing with Spark with knowledge of Spark runtime internals & Spark Structured Streaming
ā¢ Working knowledge of MLOps with a strong understanding of essential components of MLOps Architecture to build, train and deploy models
ā¢ Current knowledge across the breadth of Databricks product and platform features
ā¢ Familiarity with optimizations for performance and scalability
ā¢ Data Pipelining Experience leveraging Databricks Delta Live Tables and Data Built Tool (DBT)
ā¢ Experience with terraform, Git, CI/CD tools as well as Automation and Integration testing
ā¢ Thorough understanding of Databricks Delta, Iceberg, and Hudi
ā¢ Experience in best Spark Best Practices & Notebook, Cluster Creation & Configuration
ā¢ Ingestion Patterns & Data Quality enforcement techniques within Databricks, Spark and DLT
ā¢ Understanding of Constraints, Expectations, CDC, CDF, SCD Type 1/Type 2
ā¢ Understanding of Unity Catalog & DBX Governance/Security Models
ā¢ Familiarity with leveraging Databricks REST APIs - Testing and Deployment - SCIM API & DBX CLI
ā¢ Bachelor's Degree or equivalent experience required
Company Overview
ā¢ Onix is an AI partner and provides IP and AI-powered execution of strategic projects on Google Cloud. It was founded in 1992, and is headquartered in New York, New York, USA, with a workforce of 1001-5000 employees. Its website is https://www.onixnet.com/.
Apply tot his job
Apply To this Job
Responsibilities
ā¢ Lead the Design, development, and implementing of Lakehouse & data warehouses architecture in a cloud based data environment that integrates with an overall data architecture
ā¢ Work closely with business stakeholders to interpret their data needs and translate them into technical requirements
ā¢ Have a good understanding of data governance and develop & implement data governance policies and procedures
ā¢ Ensure data quality and integrity by implementing data testing and validation processes
ā¢ Deploying and debugging cloud data initiatives as needed in accordance with best practices throughout the development lifecycle
ā¢ Managing cloud data environments in accordance with company security guidelines
ā¢ Lead the design and build of reusable, repeatable solutions and components for future use
ā¢ Lead and mentor a team of data engineers to implement your solution designs
ā¢ Stay abreast of current and emerging trends and technologies in the data and AI/ML field
ā¢ Educate delivery teams on the implementation of new cloud-based data analytics initiatives, providing associated training as required
ā¢ Partner with Delivery, and Support teams to find opportunities to reduce manual effort needed to complete deployments
ā¢ Consult on Professional Services Engagements to help our customers design and implement data warehouse solutions
ā¢ Lead and develop best practices for the larger data analytics delivery team
ā¢ Provide client presentations to review project design, outcomes and recommendations
ā¢ Employ exceptional problem-solving skills, with the ability to see and solve issues before they snowball into problems
ā¢ Lead the orchestration and automation cloud-based data platforms
Skills
ā¢ 7+ years experience in Data Architecture, data engineering & analytics in areas such as performance tuning, pipeline integration & infrastructure configuration
ā¢ 10+ years of consulting experience
ā¢ Completed Databricks Data Engineering Professional/Associate certification OR Cloud Certification (Azure, AWS, GCP)
ā¢ Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with deep expertise in at least one
ā¢ Deep experience with distributed computing with Spark with knowledge of Spark runtime internals & Spark Structured Streaming
ā¢ Working knowledge of MLOps with a strong understanding of essential components of MLOps Architecture to build, train and deploy models
ā¢ Current knowledge across the breadth of Databricks product and platform features
ā¢ Familiarity with optimizations for performance and scalability
ā¢ Data Pipelining Experience leveraging Databricks Delta Live Tables and Data Built Tool (DBT)
ā¢ Experience with terraform, Git, CI/CD tools as well as Automation and Integration testing
ā¢ Thorough understanding of Databricks Delta, Iceberg, and Hudi
ā¢ Experience in best Spark Best Practices & Notebook, Cluster Creation & Configuration
ā¢ Ingestion Patterns & Data Quality enforcement techniques within Databricks, Spark and DLT
ā¢ Understanding of Constraints, Expectations, CDC, CDF, SCD Type 1/Type 2
ā¢ Understanding of Unity Catalog & DBX Governance/Security Models
ā¢ Familiarity with leveraging Databricks REST APIs - Testing and Deployment - SCIM API & DBX CLI
ā¢ Bachelor's Degree or equivalent experience required
Company Overview
ā¢ Onix is an AI partner and provides IP and AI-powered execution of strategic projects on Google Cloud. It was founded in 1992, and is headquartered in New York, New York, USA, with a workforce of 1001-5000 employees. Its website is https://www.onixnet.com/.
Apply tot his job
Apply To this Job