Principal Data Platform Engineer
Job Description:
• Assess and recommend architecture frameworks, design and implement high-performance solutions to support data and analytical products.
• Architect high availability, scalable and fault tolerant solutions
• Lead implementation of modern data curation solutions to allow developers to quickly onboard new data sources and enhance existing data integrations.
• Partner with teams and systems to develop tools to extract, transform, and load data from a wide variety of sources and destinations.
• Evaluate and implement efficient distributed storage and query techniques.
• Champion high-quality code with corresponding test coverage
• Participate in regular code reviews and engage in constructive discussions
• Participate in Design sessions across different teams
• Design automation tools for monitoring and measuring data quality, with associated user interfaces.
Requirements:
• 10+ years of experience in Software Engineering / Data Engineering roles working in high traffic, fault tolerant, and highly available environments
• Experience contributing to the architecture and design (architecture, design patterns, reliability and scaling) of systems
• Experience building real-time data pipelines
• Experience with Spark, Python, DBT, C#, SQL
• Experience with Big Data Technologies (Snowflake, Athena, Pinot, Clickhouse, Flink etc.)
• Experience with Streaming platforms like Kafka or Kinesis
• Experience with latest Generative AI technologies for data engineering development (Cursor, Copilot etc)
• B.S., M.S. or PhD degree in Computer Science or a related field
Benefits:
• Flextime, recognition, and support for autonomous work: Flexible time off with ample learning and development opportunities to continue growing your career.
• We offer a comprehensive onboarding program, leadership training for Titans at all levels, and other programs and events.
• Great work is rewarded through Bonusly, peer-nominated awards, and more.
• Holistic health and wellness benefits: Company-paid medical, dental, and vision (with 100% employer paid options and 90% coverage for dependents), FSA and HSA, 401k match, and telehealth options including memberships to One Medical.
• Support for Titans at all stages of life: Parental leave and support, up to $20k in fertility services (i.e. IUI and IVF), surrogacy, and adoption reimbursement, on demand maternity support through Maven Maternity, free breast milk shipping through Maven Milk, pet insurance, legal advisory services, financial planning tools, and more.
Apply Now
Apply Now
• Assess and recommend architecture frameworks, design and implement high-performance solutions to support data and analytical products.
• Architect high availability, scalable and fault tolerant solutions
• Lead implementation of modern data curation solutions to allow developers to quickly onboard new data sources and enhance existing data integrations.
• Partner with teams and systems to develop tools to extract, transform, and load data from a wide variety of sources and destinations.
• Evaluate and implement efficient distributed storage and query techniques.
• Champion high-quality code with corresponding test coverage
• Participate in regular code reviews and engage in constructive discussions
• Participate in Design sessions across different teams
• Design automation tools for monitoring and measuring data quality, with associated user interfaces.
Requirements:
• 10+ years of experience in Software Engineering / Data Engineering roles working in high traffic, fault tolerant, and highly available environments
• Experience contributing to the architecture and design (architecture, design patterns, reliability and scaling) of systems
• Experience building real-time data pipelines
• Experience with Spark, Python, DBT, C#, SQL
• Experience with Big Data Technologies (Snowflake, Athena, Pinot, Clickhouse, Flink etc.)
• Experience with Streaming platforms like Kafka or Kinesis
• Experience with latest Generative AI technologies for data engineering development (Cursor, Copilot etc)
• B.S., M.S. or PhD degree in Computer Science or a related field
Benefits:
• Flextime, recognition, and support for autonomous work: Flexible time off with ample learning and development opportunities to continue growing your career.
• We offer a comprehensive onboarding program, leadership training for Titans at all levels, and other programs and events.
• Great work is rewarded through Bonusly, peer-nominated awards, and more.
• Holistic health and wellness benefits: Company-paid medical, dental, and vision (with 100% employer paid options and 90% coverage for dependents), FSA and HSA, 401k match, and telehealth options including memberships to One Medical.
• Support for Titans at all stages of life: Parental leave and support, up to $20k in fertility services (i.e. IUI and IVF), surrogacy, and adoption reimbursement, on demand maternity support through Maven Maternity, free breast milk shipping through Maven Milk, pet insurance, legal advisory services, financial planning tools, and more.
Apply Now
Apply Now