[Remote] Data Engineer (Databricks + Informatica + Azure)

Note: The job is a remote job and is open to candidates in USA. Allata is a global consulting and technology services firm that helps organizations accelerate growth and solve complex challenges. They are seeking a skilled Data Engineer to design, build, and optimize scalable data solutions for analytics and reporting in the healthcare industry, collaborating with data architects and business stakeholders.ResponsibilitiesDesign, develop, and maintain scalable data pipelines using modern distributed data processing platforms and cloud environmentsBuild and optimize ETL/ELT processes following industry best practices and cloud-native architecturesImplement data models aligned with modern Data Lakehouse principles and data architecture frameworksEnsure data quality, consistency, and performance across ingestion, staging, and curated data layersCollaborate with data architects, analysts, and business stakeholders to understand complex healthcare data requirementsDevelop reusable data transformation logic and modular processing components for efficient, maintainable systemsSupport deployment processes following CI/CD and DevOps best practicesMonitor and optimize data workflows for performance, scalability, and reliability in production environmentsContribute to data governance, security, and compliance practices relevant to regulated healthcare environmentsSkillsProven hands-on experience with Informatica as a data integration and ETL platformStrong experience with Databricks or similar distributed data processing platformsCore expertise in data architecture, data integrations, data warehousing, and ETL/ELT process designApplied experience developing and deploying custom scripts and modules for distributed computing environments (custom code execution across parallel executors and worker nodes)Strong proficiency in SQL, Python, and PySpark (or equivalent distributed processing languages) for data transformation and processingSolid knowledge of cloud and hybrid relational database systems such as MS SQL Server, PostgreSQL, Oracle, Azure SQL, AWS RDS, or comparable enginesHands-on experience with batch and streaming data processing techniques and data compaction strategiesStrong analytical and problem-solving skillsAbility to work effectively in cross-functional and distributed teamsClear communication skills, with the ability to explain technical concepts to non-technical stakeholdersProactive mindset with a strong sense of ownershipCommitment to delivering high-quality, reliable data solutionsCompany OverviewAllata is an IT company focused on helping clients enhance or scale business opportunities, create efficiencies and more. It was founded in 2016, and is headquartered in Eagle, Idaho, USA, with a workforce of 201-500 employees. Its website is https://www.allata.com/.Company H1B SponsorshipAllata has a track record of offering H1B sponsorships, with 1 in 2025, 2 in 2022, 3 in 2021. Please note that this does not guarantee sponsorship for this specific role.