[Remote] Data Engineer - AWS/Databricks

Note: The job is a remote job and is open to candidates in USA. Acuity Inc. is a technology consulting firm that supports federal agencies, and they are seeking a highly skilled Data Engineer to join their Engineering Team. The role involves designing and delivering AWS cloud-scale data platforms, building scalable data pipelines, and implementing data solutions for federal clients.ResponsibilitiesBuild and maintain scalable PySpark-based data pipelines in Databricks notebooks to support ingestion, transformation, and enrichment of structured and semi-structured dataDesign and implement Delta Lake tables optimized for ACID compliance, partition pruning, schema enforcement, and query performance across large datasetsDevelop ETL and ELT workflows that integrate multiple source systems into a centralized, query-optimized data warehouse architectureLeverage Spark SQL and DataFrame APIs to implement business rules, dimensional joins, and aggregation logic aligned to warehouse modeling best practicesCollaborate with data architects and engineers to implement cloud-native data solutions on AWS using S3, Glue, RDS, and IAM for secure, scalable storage and access controlOptimize pipeline performance through intelligent partitioning, caching, broadcast joins, and adaptive query tuningDeploy and version data engineering assets using Git-integrated development workflows and automate deployment with CI/CD tools such as GitLab or JenkinsMonitor pipeline health, job execution, and cluster utilization using native Databricks tools and AWS CloudWatch, identifying bottlenecks and optimizing cost-performance tradeoffsConduct technical discovery and mapping of legacy source systems, identifying required transformations and designing end-to-end data flowsImplement governance practices including metadata tagging, data quality validation, audit logging, and lineage tracking using platform-native features and custom logicSupport ad hoc data access requests, develop reusable data assets, and maintain shared notebooks that meet operational reporting and analytics needs across teamsSkills2+ years of experience in data engineering and Agile analytics2+ years of experience creating software for retrieving, parsing and processing structured and unstructured data1 to 2 years of experience building scalable ETL and ELT workflows for reporting and analytics1 or more years experience building enterprise data engineering solutions in the cloud, with preferred experience with cloud native technologies from AWS and DatabricksExperience with data quality, validation frameworks, and storage optimization strategiesBA or BS degreeMust be US Citizen with an ability to obtain and maintain US SuitabilityBenefitsPersonalized development plansMentorshipUp to $6,000 annually for training and certificationsCompetitive compensationComprehensive benefitsA strong focus on work-life balanceCompany OverviewAcuity is an information technology company that offers cybersecurity and project management services. It was founded in 2002, and is headquartered in Reston, Virginia, USA, with a workforce of 201-500 employees. Its website is http://myacuity.com.