Senior Azure Databricks Engineer With Azure Fabric
Title: Senior/Lead Data Engineer Location: 100% Remote – PST Hours (8 AM – 5 PM PST) – Travel to Fremont, CA once every 2 Months for 3 Days (Expenses Paid) Job Type: Contract – 12 Months Key Skills: Sql, PySpark, Azure, Microsoft Fabric, ADF, and Databricks. About the Role: We are seeking a highly skilled and experienced Senior/Lead Data Engineer to join our dynamic team , working on challenging and multi-year data transformation projects. This is an excellent opportunity for a talented data engineer to play a key role in building innovative data solutions using Azure Native Services and related technologies. If you are passionate about working with large-scale data systems and enjoy solving complex engineering problems, this role is for you. Key Responsibilities: • Data Engineering : Design, development, and implementation of data pipelines and solutions using PySpark, SQL, and related technologies. • Collaboration: Work closely with cross-functional teams to understand business requirements and translate them into robust data solutions. • Data Warehousing: Design and implement data warehousing solutions, ensuring scalability, performance, and reliability. • Continuous Learning: Stay up to date with modern technologies and trends in data engineering and apply them to improve our data platform. • Mentorship: Provide guidance and mentorship to junior data engineers, ensuring best practices in coding, design, and development. Must-Have Skills & Qualifications: • Minimum 12+ years of overall experience in IT Industry. • 8+ years of experience in data engineering, with a strong background in building large-scale data solutions. • 4+ years of hands-on experience developing and implementing data pipelines using Azure stack experience (Azure, ADF, Databricks, Functions) • 1-2 years of experience in Microsoft Fabric • Some exposure/experience in SAP constructs • Proven expertise in SQL for querying, manipulating, and analyzing large datasets. • Strong knowledge of ETL processes and data warehousing fundamentals. • Self-motivated and independent, with a “let’s get this done” mindset and the ability to thrive in a fast-paced and dynamic environment. Good-to-Have Skills: • Databricks Certification is a plus. • Data Modeling, Azure Architect Certification