[Remote] Staff Software Engineer, Data Ingestion - Slack
Note: The job is a remote job and is open to candidates in USA. Salesforce is the leading AI CRM company, seeking a Staff Software Engineer to join the Data Ingestion Team at Slack. The role involves designing and developing scalable streaming and batch data pipelines, implementing Lakehouse solutions, and collaborating with cross-functional partners to enhance data ingestion processes.ResponsibilitiesDesign and develop highly scalable and resilient streaming and batch pipelines for ingesting and processing structured and unstructured datasetsDesign and implement Slackβs Lakehouse solutions and enable production use cases for customersImprove the reliability and performance of the services/pipelines through AI assisted and/or Agentic solutions and toolsAutomate and handle the lifecycle of datasets (schema evolution, metadata management, change and backfill management, deprecation and migration)As one of the tech leads, comfortably collaborate with cross functional partners and lead technical initiatives independently end to endBe a role model and a multiplier, coaching and mentoring other engineers across the team and the orgWrite, review, or provide feedback on a technical design proposal from othersSkillsU.S. citizenship and willing to undergo a background check for GovSlack authorization. We can not provide visa sponsorship for this role7+ years of software/data engineering experience, including experience with building applications using Streaming and Lakehouse technologies, e.g. Kafka/Kafka Connect, Flink/Spark Streaming, Iceberg/Hudi/Delta or equivalentYou have hands on experience and knowledge on building and maintaining batch data pipelines using Spark, Airflow, EMR, S3 or equivalentYou are proficient in object-oriented and/or functional programming languages: SQL, Python, Java/Scala, Go or equivalentYou are skilled at crafting and building robust distributed microservices with tools like Kubernetes, Docker, AWS ECS/EKS, Terraform, Grafana, etcYou are familiar with AI-assisted software development and automation and have hands on experience of Claude Code/Codex or equivalentYou have excellent written and verbal communication and interpersonal skills; able to effectively collaborate with cross functional partners and explaining sophisticated technical concepts to non-technical stakeholdersBenefitsCertain roles may be eligible for incentive compensation, equity, and benefits.Salesforce offers a variety of benefits to help you live well including: time off programs, medical, dental, vision, mental health support, paid parental leave, life and disability insurance, 401(k), and an employee stock purchasing program.Company OverviewSlack is a cloud-based communication and collaboration platform for teams. It is a sub-organization of Salesforce. It was founded in 2009, and is headquartered in San Francisco, California, USA, with a workforce of 1001-5000 employees. Its website is http://www.slack.com.