[Remote] Kafka Platform Engineer
Note: The job is a remote job and is open to candidates in USA. Bright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their operations. We are seeking an experienced Kafka Platform Engineer to architect, deploy, and operate large-scale Apache Kafka and Confluent platform environments supporting mission-critical event-driven workloads. The ideal candidate will own the Kafka platform end-to-end and work closely with cross-functional partners to deliver a reliable and performant streaming platform.ResponsibilitiesArchitect, deploy, and operate large-scale Apache Kafka or Confluent Platform clusters across on-prem and cloud environmentsDesign partitioning, replication, and topic strategies that balance throughput, durability, and operational simplicityImplement strong security on Kafka clusters using SASL, mTLS, ACLs, RBAC, and integration with corporate IdPsOperate Schema Registry, Kafka Connect, KSQL/ksqlDB, and Kafka Streams in productionBuild and operate Kafka Connect pipelines integrating sources and sinks across enterprise systemsDesign HA/DR strategies for Kafka, including MirrorMaker 2, Cluster Linking, and multi-region active-active patternsBuild CI/CD pipelines for Kafka topic, ACL, and connector configurations using GitOps patternsImplement comprehensive observability using Prometheus, Grafana, Datadog, or Confluent Control CenterDrive Kafka cost and capacity optimization through right-sizing and storage tieringOnboard application teams to Kafka with clear patterns, templates, and best practicesLead incident response and post-incident reviews for streaming workloads, applying disciplined engineering practices and partnering closely with stakeholders to ensure outcomes are durable, well-documented, and aligned with broader team and platform standardsMentor and coach junior and mid-level engineers through code review, design review, pair programming, and structured knowledge sharing, helping the broader team grow in technical maturity and confidence over timeMaintain comprehensive, current technical documentation β including architecture diagrams, design decisions, configuration references, runbooks, and operational procedures β so that the system remains supportable, auditable, and easy to onboard new engineers onto over timeContinuously evaluate emerging streaming technologies (Pulsar, Redpanda, AWS MSK, Azure Event Hubs)SkillsBachelor's degree in Computer Science, Engineering, or a related technical disciplineFive or more years of experience operating Apache Kafka or Confluent Platform in productionDeep, hands-on knowledge of Kafka internals (partitions, replication, ISRs, consumer groups)Strong experience with Kafka security (SASL, mTLS, ACLs, RBAC)Hands-on experience with Kafka Connect, Schema Registry, and either Kafka Streams or ksqlDBExperience with HA/DR strategies for KafkaStrong scripting skills in Python, Bash, or GoHands-on experience with infrastructure-as-code (Terraform, Ansible)Working knowledge of observability tooling for KafkaExcellent troubleshooting, communication, and documentation skillsConfluent Certified Administrator or Developer credentialsExperience operating Kafka on Kubernetes (Strimzi, Confluent Operator)Exposure to managed Kafka services (AWS MSK, Azure Event Hubs Kafka API)Familiarity with stream processing frameworks (Flink, Spark Streaming)Experience with data governance and lineage for streaming dataBenefitsCompetitive base salary commensurate with experience, plus benefits.100% remoteFull-time, direct W2 with Bright Vision Technologies (no C2C, no 1099, no third-party)No new H1B sponsorship available. H1B transfers welcomed for qualified candidates.We will support H1B transfers for qualified candidates.Company OverviewBright Vision Technologies is an information technology company that offers software development, AI, and cybersecurity services. It was founded in 2020, and is headquartered in Bridgewater, New Jersey, USA, with a workforce of 51-200 employees. Its website is https://bvteck.com.