[Remote] Senior Data Engineer
Note: The job is a remote job and is open to candidates in USA. Gainwell Technologies is dedicated to improving the health and well-being of vulnerable communities through innovative technology. The Data Engineer will design, develop, and maintain scalable data pipelines and models that support analytics and decision-making, collaborating with cross-functional teams to ensure data accessibility and governance.ResponsibilitiesArchitect Scalable Data Pipelines: Design, develop, and maintain reliable ETL/ELT workflows using Databricks, Spark, and PythonEnable Data Access & Analytics: Partner with analytics, product, and engineering teams to ensure timely, accurate, and governed access to data for downstream reporting and analyticsOptimize Data Workflows: Improve performance, reduce latency, and streamline processes by tuning SQL, optimizing Spark jobs, and enhancing cloud data pipelinesLeverage Cloud Infrastructure: Utilize AWS services (e.g., S3, Glue, Lambda) to manage and scale data engineering workloadsDrive Best Practices: Establish and maintain data engineering standards, including code quality, data security, version control, and documentationBuild & Maintain Data Models: Construct and support dimensional and normalized data models that support cross-functional use cases and reporting needsAutomation & Monitoring: Set up robust pipeline orchestration (e.g., with Airflow, Databricks Jobs, or AWS Step Functions) and monitoring/alerting systemsCollaborate Cross-Functionally: Work with data analysts, scientists, and business users to understand requirements and transform raw data into business-ready datasetsSkills3+ years of experience as a Data Engineer or in a similar roleStrong hands-on experience with Databricks (Spark, Delta Lake) and Python-based ETL frameworksSolid experience working with AWS cloud services for data processing and storageModerate-to-advanced proficiency in SQL for data wrangling, transformation, and performance tuningExperience with data lake architectures, ELT/ETL development, and orchestration toolsFamiliarity with software engineering best practices, including CI/CD, version control, and code reviewsExperience with Power BI or other BI tools (e.g., Tableau, Looker) to assist in data visualization or self-service reporting enablementBenefitsGenerous, flexible vacation policyEducational assistanceComprehensive health benefits401(k) employer matchA variety of leadership and technical development academies to help build your skills and capabilitiesCompany OverviewGainwell Technologies is a provider of Information Technology & Services. It is a sub-organization of Veritas Capital. It was founded in 2009, and is headquartered in Irving, Texas, USA, with a workforce of 10001+ employees. Its website is https://www.gainwelltechnologies.com/.