[Remote] Senior Data Engineer - Data Insights
Note: The job is a remote job and is open to candidates in USA. Appfire is a software company that empowers teams to collaborate seamlessly. They are seeking a Senior Data Engineer to take ownership of their core infrastructure, develop architectures for their data platform, and drive AI adoption in engineering workflows.ResponsibilitiesOwn the complete solution development lifecycle, from driving initial requirements to building Proof of Concepts (POCs) and Minimum Viable Products (MVPs), and continuously iterating to improve and scale production solutionsWork closely with internal and external partners to stand up and optimize robust data delivery solutionsBuild, manage, and scale complex data pipelines (ETL and reverse ETL) utilizing expert-level Python and AirflowArchitect and maintain highly efficient, cost-effective scalable data solutions and cloud infrastructure from scratchBe the key driver in the evolution of our custom data lake ("firelake" built on AWS/Snowflake)Manage Fivetran and custom pipeline operations, proactively handle schema drift, and implement rigorous data quality checks to ensure we have ingested a true and accurate representation of all source systemsSpearhead AI adoption in our daily engineering workflows to automate Pull Requests, enforce new "definition of done" standards, and accelerate CI/CD, test coverage, and release managementDrive the integration of AI capabilities directly into our data solutions by interfacing with LLMs and developing intelligent assistants and agents to solve complex business problemsStay on the forefront of the rapidly evolving data landscape and drive proof-of-concepts for new tools to ensure we leverage best-in-class technologies to scale quicklyImplement advanced PII management by leveraging automated data classification techniques, applying masking policies, and enforcing sophisticated row-level and column-level security practicesDevelop and deploy robust monitoring solutions and governance strategies to ensure accurate, secure data is available on time and to the correct audienceAutonomously lead 3-5 concurrent cross-departmental data projects, driving everything from requirements gathering and UAT to production deploymentPartner seamlessly with business, analytics, and engineering teams, translating complex technical architectures into relatable concepts to influence stakeholders and align goalsChampion best practices, systematically reduce technical debt, write clear documentation, and provide both technical and soft-skill mentorship to junior team membersSkills5+ years in a data or software engineering role with a deep understanding of the full data lifecycle, modern data warehousing, and agile software development best practices5+ years of experience autonomously building scalable data products, pipelines, and solutions that support company-wide systems and overarching business goalsExceptional personal organization and multitasking skills, with the ability to work with minimal supervision while driving 3-5 concurrent cross-departmental projects5+ years of advanced SQL optimization and complex ETL/ELT pipeline development, with extensive, hands-on experience in Snowflake5+ years of advanced Python programming5+ years of experience designing and maintaining AWS cloud environments. Strong, hands-on proficiency with Terraform and Docker is requiredDeep operational experience with Airflow for orchestration, dbt (3+ years) for transformation, and familiarity with managing Fivetran pipelinesProven ability to design pragmatic, cost-effective architectures from scratch that prioritize security, scalability, and high performance without over-engineeringIncredibly strong troubleshooting skills with a ruthless dedication to reducing technical debt, optimizing CI/CD pipelines, and enforcing strict version control and testing standardsSolid understanding of modern data governance principles, including automated data classification, PII masking, and row/column-level access controlsStrong written and verbal skills, with a proven ability to translate and simplify complex technical architectures to both engineering peers and non-technical business stakeholdersA team-oriented mindset with a passion for coaching and providing constructive feedback to junior team membersExperience in or foundational knowledge of MLOps. You can provide recommendations and establish best practices to guide our strategic expansion into this spaceExperience interfacing with LLMs, creating AI agents, or leveraging AI tools to accelerate daily engineering workflows (e.g., automating code reviews, CI/CD enhancements)BenefitsEvery Appfire team member is eligible for company equity, fostering a genuine sense of ownership and shared success as we continue to grow.Unlimited Paid Time Off (PTO)10 paid company holidays annuallyMedical insurance fully covered by Appfire (100% employer-paid)Dental insurance with costs shared 50/50 between Appfire and employeesVision insuranceGroup Term Life InsuranceVoluntary Life InsuranceCritical Illness coverageAccident InsuranceLong-Term Disability coverageEmployee Assistance Program (EAP)Employees are eligible for fitness and wellness reimbursements through our benefits provider.Appfire University, our custom on-demand learning platform designed to support continuous professional development.Three fully paid volunteer days per year to participate in our Corporate Social Responsibility (CSR) initiatives and support local communities.Flexible Spending Accounts (FSA)Monthly remote-work stipendDedicated Amazon account for ordering approved equipment and peripheralsCompetitive 401(k) plan with company matching to help build long-term financial securityThis role is fully remote and can be performed anywhere within the United States.Appfire also offers access to our offices in Boston, Burlington, and New York.Company OverviewAppfire is the leading global provider of software that enhances, extends, and connects the world's leading platforms to make work flow any way teams want to work, from planning to product ideation, product development, project delivery, and beyond. It was founded in 2005, and is headquartered in Burlington, Massachusetts, USA, with a workforce of 501-1000 employees. Its website is https://www.appfire.com/.