[Remote] Data Engineer

Note: The job is a remote job and is open to candidates in USA. Data Surge is disrupting the services industry with cutting-edge technology, and they are seeking a skilled and motivated Senior Data Engineer with deep Databricks and cloud experience. The role involves designing and implementing scalable data solutions, optimizing pipelines, and automating infrastructure within secure cloud environments.ResponsibilitiesDesign, develop, and optimize robust data pipelines in Databricks to process and transform large-scale data setsCollaborate with data scientists, engineers, and cloud architects to build reliable, secure data systemsAutomate infrastructure provisioning using Terraform and manage resources on Azure (or AWS/GCP)Monitor, troubleshoot, and support production-grade data pipelines and jobsDevelop CI/CD workflows to streamline deployment and version control of data processing codeEnsure security, performance, and reliability across all stages of data workflowUtilize and manage Docker containers where needed to deploy data servicesParticipate in Agile team ceremonies and help shape iterative data delivery plansSupport continuous improvement in data architecture, automation, and governance practicesOther duties as reasonably requiredSkillsU.S. Citizenship5+ years of experience in data engineering or backend data infrastructure roles2+ years of hands-on experience with Databricks, Spark, or distributed data processing systems in a production environmentDeep proficiency with PySpark and Python for data engineering tasksExperience with data modelingSolid experience with Airflow, dbt, or other orchestration and transformation toolsProven skills in data governance, lineage, or security best practicesExperience working with Azure (preferred), AWS, or Google CloudStrong working knowledge of CI/CD tools and version control workflowsComfortable working with relational (e.g., PostgreSQL, MySQL) and NoSQL databasesProven experience in monitoring, debugging, and scaling cloud-based data systemsStrong communication skills and ability to work independently in a remote team environmentExperience with Kubernetes and Helm for deploying data workloads (not required)Solid experience with Terraform or other Infrastructure as Code toolsFamiliarity with containerization using DockerKnowledge of data lakehouse architectures and Delta LakeExperience working on Federal or government projectsExisting security clearance (preferred but not required)Databricks CertificationBachelor'sData Engineering: 7 yearsDatabricks: 3 yearsBenefitsComprehensive BenefitsRemote-first work environmentPTO – Including holidays + your birthday401(k) with 4% Match, immediately vestedGrowth and development opportunitiesBonuses + more401(k)401(k) matchingDental insuranceHealth insurancePaid time offRetirement planVision insuranceCompany OverviewData Surge is a business and technology consulting firm that provides data and software solutions. It was founded in undefined, and is headquartered in Folsom, California, USA, with a workforce of 11-50 employees. Its website is https://datasurge.com.