[Remote] Microsoft Databricks Engineer

Note: The job is a remote job and is open to candidates in USA. 4A Consulting, LLC is seeking a highly skilled Microsoft Databricks Engineer to design, build, and support scalable data pipelines and Lakehouse solutions using Databricks on Azure. The role involves developing reliable data products, enabling enterprise analytics, and supporting modern data architecture initiatives using Medallion Architecture and Data Mesh concepts.ResponsibilitiesDesign, develop, and maintain scalable data pipelines and ETL/ELT processes using Databricks and cloud-based technologiesBuild and support Lakehouse architectures using Databricks and cloud data platformsTranslate business requirements into reliable datasets, data products, and analytics-ready solutionsImplement and maintain data ingestion, transformation, and orchestration workflowsSupport enterprise data architecture initiatives, including Medallion Architecture (Bronze, Silver, Gold) and Data Mesh principlesDevelop and optimize data models, database structures, and storage solutions across relational and NoSQL platformsImplement data quality, governance, security, and compliance best practices throughout the data lifecycleSupport workflow orchestration and scheduling using tools such as Airflow or LuigiMonitor, troubleshoot, and optimize data pipelines and platform performanceCollaborate with analysts, architects, developers, and business stakeholders to support data-driven initiativesCreate and maintain technical documentation, standards, and operational proceduresSkillsStrong hands-on experience with Databricks and core data engineering technologies including SQL, Python, and Apache SparkExperience designing, developing, and maintaining ETL/ELT pipelines and data integration solutionsExperience working with cloud data platforms, preferably Microsoft AzureStrong understanding of data modeling, data architecture, and database design principlesExperience working with relational and NoSQL databasesKnowledge of data governance, data quality, security, and compliance best practicesExperience with workflow orchestration tools such as Airflow or LuigiUnderstanding of Medallion Architecture and modern data platform design principlesFamiliarity with centralized and decentralized data architectures, including Data Mesh conceptsStrong troubleshooting, analytical, communication, and documentation skillsExperience with Snowflake, Amazon Redshift, BigQuery, or other cloud data warehouse platformsExperience with business intelligence and visualization tools such as Power BI or TableauExperience with data platform performance tuning, optimization, and troubleshootingKnowledge of machine learning platforms and data science workflowsExperience with real-time streaming technologies such as Kafka or FlinkProfessional experience with Go (Golang)Experience working in healthcare, finance, or other regulated industriesCompany Overview4A Consulting is a leading IT Services and Consulting firm, certified as an 8(a) Small Disadvantaged Business (SDB), Women-Owned Small Business (WOSB), and Minority Business Enterprise (MBE). It was founded in 2014, and is headquartered in Ellicott City, Maryland, USA, with a workforce of 51-200 employees. Its website is https://4a-consulting.com.Company H1B Sponsorship4A Consulting, LLC has a track record of offering H1B sponsorships, with 3 in 2026, 5 in 2025, 5 in 2023, 1 in 2022, 2 in 2021. Please note that this does not guarantee sponsorship for this specific role.