[Remote] Senior Data Engineer - AWS
Note: The job is a remote job and is open to candidates in USA. Fractal is a strategic AI partner to Fortune 500 companies, aiming to enhance human decision-making in enterprises. They are seeking a Senior Data Engineer - AWS to design and build scalable data pipelines on AWS, guide client teams through data platform best practices, and act as a technical consultant to solve complex data challenges.ResponsibilitiesDesign, build, and maintain scalable data pipelines using AWS services such as S3, Lambda, Step Functions, Glue (Serverless), and EventBridge, landing curated data in SnowflakeDevelop and optimize ETL/ELT workflows using PySpark, Parquet file formats, and Apache Iceberg table formatsBuild and maintain semantic layers in Snowflake to enable consistent, governed, business-ready analyticsManage metadata and data discovery using AWS Glue Catalog and Glue Crawlers, and enable analytics through AthenaImplement event-driven architectures with SNS and EventBridge for data processing and notificationsEnable secure data lake operations using AWS Lake Formation for access control and governanceSupport data ingestion and migration initiatives, including migrating data from Teradata to S3Ensure reliable deployments and infrastructure automation using uDeploy, CloudFormation, Terraform, CDK, and GitHubCollaborate on cost reporting, monitoring, and optimization, and research emerging AWS features (e.g., S3 Tables) to improve performance, scalability, and cost efficiencyAct as a hands-on subject-matter expert and technical consultant for client stakeholders and their engineering teamsMentor and upskill client engineers, sharing best practices for AWS and Snowflake data engineering and raising the technical bar across the teamPartner with cross-functional teams to translate business problems into robust, scalable, end-to-end data solutionsSkillsExpert-level data engineer with extensive, hands-on experience designing and building production data platforms on AWSProven ability to build end-to-end data pipelines from the ground up—ingestion, transformation, and delivery—not just maintain existing onesHands-on experience designing and building semantic layers in SnowflakeTrack record of acting as a technical subject-matter expert or consultant, advising and upskilling client teams and engineering stakeholdersComfortable being the most senior technical voice in the room and translating complex engineering concepts for both technical and business audiencesExcellent problem-solving skills and the ability to collaborate effectively across cross-functional teamsSelf-directed and proactive, able to balance multiple workstreams with a focus on quality and deliveryDeep, hands-on expertise with core AWS data services: S3, Lambda, Step Functions, Glue (Serverless), Glue Catalog, Glue Crawlers, Athena, SNS, EventBridge, and Lake FormationStrong proficiency in PySpark and building production ETL/ELT workflows, including with columnar and open table formats such as Parquet and Apache IcebergHands-on Snowflake experience, including designing and building semantic layersPractical knowledge of infrastructure-as-code and CI/CD tooling: CloudFormation, Terraform, CDK, uDeploy, and GitHubExperience with large-scale data migrations (e.g., migrating from Teradata to S3)Strong understanding of cost management, monitoring, and reporting in AWS environmentsWorking knowledge of data lake architectures, metadata management, and data governanceBachelor's degree with a quantitative or technical emphasis: Computer Science, Engineering, Data Science, Mathematics, Information Systems, or a related fieldExtensive hands-on data engineering experience, typically 7+ years, with deep expertise in AWS and SnowflakeMaster's degree desirableBenefitsDiscretionary bonus for the current performance periodEligible to participate in the health, dental, vision, life insurance, and disability plans in accordance with the plan documents, which may be amended from time to timeEligible for benefits on the first day of employment with the CompanyEligible to participate in the Company 401(k) Plan after 30 days of employment, in accordance with the applicable plan terms11 paid holidays12 weeks of Parental Leave“free time” PTO policy, allowing you the flexibility to take the time needed for either sick time or vacationCompany OverviewFractal is an AI firm with the aspiration to power every human decision in theenterprise. It was founded in 2000, and is headquartered in Mumbai, Maharashtra, IND, with a workforce of 5001-10000 employees. Its website is http://www.fractal.ai.