[Remote] Data Engineer (Databricks) - Remote USA

Note: The job is a remote job and is open to candidates in USA. ICF is a global advisory and technology services provider, and they are seeking a motivated, experienced Senior Databricks SME. The role involves enabling efficient data exchange, supporting data pipeline development in Azure, conducting data profiling, and collaborating with clients to translate data needs into scalable solutions.ResponsibilitiesEnable secure, scalable, and efficient data exchange between federal client and external data sharing partners using Databricks Delta SharingSupport the design and development of data pipelines and ETL routines in Azure Cloud environment for many source system types including RDBMS, API, and unstructured data using CDC, incremental, and batch loading techniquesConduct data profiling, transformation, and quality assurance on structured, semi-structured, and unstructured dataIdentify underlying issues and translate them into technical requirementsAssist in building and optimizing data lakes, feature stores, and data warehouse structures to support analytics and machine learningPrepare, structure, and validate data for data science and MLOps workflows, ensuring it meets the quality and format requirements for modelingHelp monitor and maintain the flow of data across BI dashboards, analytics environments, and machine learning pipelinesEngage directly with clients and stakeholders to understand data needs and translate them into scalable solutionsCollaborate with UX designers, business analysts, developers, and end users to define data and reporting requirementsWork with external data partners to determine their data product needs and work within the Databricks platform to enable rapid prototyping and extensible use casesMeet with government employees at executive levels, platform stakeholders, and vendor partnersWork within Agile teams to support iterative development, backlog grooming, and sprint-based deliveryProvide mentorship to junior resourcesSkillsBachelor's degree5+ years in data engineering, data security practices, data platforms, and analyticsU.S. Citizenship required due to federal contract requirementsAbility to obtain and maintain a federal public trust clearance or equivalent client-required background investigationCandidate must reside in the U.S., be authorized to work in the U.S., and all work must be performed in the U.SCandidate must have lived in the U.S. for three (3) full years out of the last five (5) years3+ years Databricks Platform Expertise – SME Level Proficiency including: Databricks, Delta Lake, and Delta SharingDeep experience with distributed computing using Apache SparkKnowledge of Spark runtime internals and optimizationAbility to design and deploy performant end-to-end data architectures4+ years of ETL Pipeline Development building robust, scalable data pipelinesDatabricks certifications - Professional or specialty certificationsHands-on experience with Azure services such as Synapse, Data Factory, or DatabricksFamiliarity with data visualization tools such as Tableau, Power BI, or similarMachine Learning and Analytical Skills including: MLOps - Working knowledge of ML deployment and operationsData Science Methodologies - Statistical analysis, modeling, and interpretationBig Data Technologies - Experience beyond Spark with distributed systemsExperience with deployment pipelines, including Git-based version control and CI/CD pipelines and DevOps practices using Terraform for IaCEmergency management domain knowledge a plusAdvanced proficiency in data engineering and analytics using Python, Expert-level SQL skills for data manipulation and analysis and experience with Scala, preferred but not required (Python expertise can substitute)Proven experience breaking down complex ideas into manageable componentsDemonstrable experience developing rapid POCs and PrototypesHistory of staying current with evolving data technologies and methodologiesStrong analytical thinking, attention to detail, and willingness to learn new tools and technologiesConsulting experience with ability to work directly with clients, executive level stakeholders and manage conflictsCompany OverviewICF is a global consulting and technology services provider focused on making big things possible for our clients. It was founded in 1969, and is headquartered in Fairfax, Virginia, USA, with a workforce of 5001-10000 employees. Its website is https://www.icf.com.