[Remote] Data Engineer EDAP
Note: The job is a remote job and is open to candidates in USA. ETalentNetwork is a company focused on delivering data-driven solutions. They are seeking a detail-oriented Data Engineer to implement and optimize data models, design scalable data pipelines, and ensure data accuracy and integrity.ResponsibilitiesImplement and optimize data models and structures within Databricks to support efficient querying, analytics, and reportingDesign, develop, and maintain scalable data pipelines and ETL/ELT workflows, with a strong emphasis on dimensional data modeling and data qualityPartner with engineering teams and business stakeholders to gather requirements and deliver reliable analytics solutionsDevelop, optimize, and maintain SQL queries, notebooks, and scripts for data ingestion, transformation, and processingEnsure data accuracy, consistency, and integrity through validation, monitoring, and data cleansing processesCreate and maintain comprehensive documentation for data pipelines, models, and analytics solutionsMonitor, troubleshoot, and optimize data pipelines and analytics workloads to ensure performance and reliabilityStay current with industry trends, including AI-driven analytics tools, semantic modeling, and emerging data engineering best practicesSkillsDetail-oriented and analytical problem solverAbility to communicate clearly and collaborate effectively with cross-functional teamsAdaptable, service-oriented, curious, and passionate about using modern data technologiesHighly organized and proactiveAbility to manage multiple priorities while maintaining a strong focus on quality, scalability, and innovationImplement and optimize data models and structures within DatabricksDesign, develop, and maintain scalable data pipelines and ETL/ELT workflowsPartner with engineering teams and business stakeholders to gather requirementsDevelop, optimize, and maintain SQL queries, notebooks, and scripts for data ingestion, transformation, and processingEnsure data accuracy, consistency, and integrity through validation, monitoring, and data cleansing processesCreate and maintain comprehensive documentation for data pipelines, models, and analytics solutionsMonitor, troubleshoot, and optimize data pipelines and analytics workloadsStay current with industry trends, including AI-driven analytics tools, semantic modeling, and emerging data engineering best practicesHands-on experience implementing and operating solutions in DatabricksStrong understanding of ETL/ELT architectures and data ingestion patternsProficiency in Python and/or Spark for large-scale data processingExperience designing and implementing dimensional data models in data lakehouse environmentsFamiliarity with AI-driven analytics platforms, semantic modeling concepts, and NLP techniquesExperience working in SAFe Agile or other scaled Agile environmentsSolid understanding of data governance, security, and compliance best practices in global environments with numerous data providers and consumersBachelor's degree in Computer Science, Data Science, Engineering, or a related field preferredMaster's degree is a plusDatabricks and Azure certifications strongly preferredCompany OverviewE Talent Network is an Recruitment Process Outsourcing company specializes in Staffing and Recruiting. It was founded in undefined, and is headquartered in Mclean, Virginia, USA, with a workforce of 51-200 employees. Its website is http://etalentnetwork.com/.