Lead Data Engineer
Important Information
Location: Brazil Job Mode: Full-time Work Mode: Work from home
Job Summary
As a Senior Data Engineer , you will be responsible for designing, developing, and maintaining high-quality software solutions. You will collaborate with cross-functional teams to understand business requirements and translate them into scalable and efficient software applications. Your role will involve leading technical projects, mentoring junior engineers, and continuously improving software development practices to ensure the delivery of robust and reliable software systems.
Responsibilities and Duties
Lead and mentor a team of data engineers, providing technical guidance, code reviews, and best practices to ensure high-quality deliverables;
Own the end-to-end data migration strategy from Snowflake on AWS to Azure Databricks and DBT, including planning, execution, and optimization;
Collaborate with cross-functional stakeholders (data, product, architecture, and business teams) to align data initiatives with organizational goals;
Architect and oversee scalable, secure, and reliable data pipelines and infrastructure in Azure;
Drive the design and implementation of infrastructure-as-code using Terraform, ensuring consistency and maintainability;
Ensure efficient data integration between Snowflake and Azure environments, establishing robust and scalable data flows;
Oversee data transformation frameworks using Databricks and DBT, promoting reusable and modular design patterns;
Establish and enforce data engineering standards, governance practices, and CI/CD workflows;
Proactively identify risks, troubleshoot complex technical issues, and implement long-term solutions;
Lead documentation efforts for architecture, processes, and best practices across the data platform.
Essential Skills
Experience in Data Engineering;
Proven experience leading data engineering teams and delivering large-scale data platform initiatives;
Strong hands-on experience with Snowflake, Azure Databricks, and DBT;
Deep expertise in cloud infrastructure and infrastructure-as-code tools, especially Terraform;
Extensive experience with cloud data migration projects (AWS to Azure preferred);
Strong experience with CI/CD pipelines and Git-based version control;
Advanced proficiency in SQL, data modeling, and ETL/ELT design patterns;
Strong understanding of data architecture, scalability, and performance optimization;
Ability to operate in a fast-paced, collaborative, and evolving environment;
Mandatory experience in the insurance industry, with understanding of insurance data domains (policies, claims, underwriting, etc.).
Highly Desirable Skills
Experience with data governance frameworks (data cataloging, lineage, quality, and observability tools);
Knowledge of security and compliance standards relevant to insurance and financial data;
Familiarity with streaming and real-time data processing (Kafka, Event Hubs, Delta Live Tables);
Experience designing lakehouse architectures and implementing cost-optimization strategies;
Exposure to multi-cloud environments and advanced automation practices.
About EncoraEncora is the preferred digital engineering and modernization partner of some of the world’s leading enterprises and digital native companies. With over 9,000 experts in 47+ offices and innovation labs worldwide, Encora’s technology practices include Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering.At Encora, we hire professionals based solely on their skills and qualifications, and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.
Apply Now