[Remote] Senior Data Engineer

Note: The job is a remote job and is open to candidates in USA. Thrive Market is an online, membership-based market dedicated to making healthy and sustainable living affordable for everyone. They are seeking a Senior Data Engineer to build high-impact products, focusing on data processing and analytics initiatives that provide value to their members.ResponsibilitiesWork across multiple projects and efforts to orchestrate and deliver cohesive data engineering solutions in partnership with various functional teams at Thrive MarketBe hands-on and take ownership of the complete cycle of data services, from data ingestion, data processing, and ETL to data delivery for reportingCollaborate with other technical teams to deliver data solutions that meet business and technical requirements; define technical requirements and implementation details for the underlying data lake, data warehouse, and data martsIdentify, troubleshoot, and resolve production data integrity and performance issuesCollaborate with all areas of data management as lead to ensure patterns, decisions, and tooling are implemented in accordance with enterprise standardsPerform data source gap analysis and create data source/target catalogs and mappingsDevelop a thorough knowledge and understanding of cross-system integration, interactions, and relationships in order to develop an enterprise view of Thrive Market’s future data needsDesign, coordinate, and execute pilots/prototypes/POC to provide validation on specific scenarios and provide an implementation roadmapRecommend/Ensure technical functionality (e.g. scalability, security, performance, data recovery, reliability, etc.) for Data EngineeringFacilitate workshops to define requirements and develop data solution designsApply enterprise and solution architecture decisions to data architecture frameworks and data modelsMaintain a repository of all data architecture artifacts and proceduresCollaborate with IT teams, software providers, and business owners to predict and devise data architecture that addresses business needs for collection, aggregation, and interaction with multiple data streamsSkillsExcellent communication and presentation skills (verbal, written, presentation) across all levels of the organization. Ability to translate ambiguous concepts into tangible ideasHands on experience programming in Python, DBT and AirflowExpertise with RDBMS and Data Warehousing (Strong SQL) with Snowflake or similarIn-depth knowledge and experience with data and information architecture patterns and implementation approaches for Operational Data Stores, Data Warehouses, Data Marts and Data LakesExperience administering and managing data infrastructure using TerraformProficiency in logical/physical data architecture, design and developmentExperience in Data lake / Big data analytics platform implementation either cloud based or on-premise; AWS preferredExperience working with high volumes of data; experience in design, implementation and support of highly distributed data applicationsExperience evaluating and working with tools and vendors that support marketing measurement frameworks, including MMM and MTA, is a plusExperience with Development Tools for CI/CD, Unit and Integration testing, Automation and Orchestration E.g. GitHub, JenkinsExperience using Claude or similar AI agents for development is a plusExperience with writing Kafka producers and consumers or experience with AWS KinesisA knack for independence (hands-on) as well as team workExcellent analytical and problem-solving skills, often in light of ill-defined issues or conflicting informationExperience with streaming data ingestion, machine-learning, Apache Spark a plusAdept in the ability to elicit, gather, and manage requirements in an Agile delivery environmentBenefitsTotal Compensation includes Base Salary, Stock Options, Health & Wellness Benefits, Flexible PTO, and more!Comprehensive health benefits (medical, dental, vision, life and disability)Competitive salary (DOE) + equity401k plan9 Observed HolidaysFlexible Paid Time OffSubsidized ClassPass Membership with access to fitness classes and wellness and beauty experiencesAbility to work in our beautiful office in Playa VistaFree Thrive Market membership with exclusive employee discountCoverage for Life Coaching & Therapy Sessions on our holistic mental health and well-being platformCompany OverviewThrive Market is a membership-based online company that offers natural and organic food products. It was founded in 2013, and is headquartered in Los Angeles, California, USA, with a workforce of 501-1000 employees. Its website is https://thrivemarket.com.