Senior Cloud Infrastructure Engineer
About LanceDB LanceDB is a developer-friendly, open-source data lake for multimodal AI. From hyper-scalable vector search to advanced retrieval for RAG, from streaming training data to interactive exploration of large-scale AI datasets, LanceDB is the best foundation for your AI application, and powers some of the most groundbreaking applications and challenging requirements today. About the role We’re seeking a seasoned Cloud Infrastructure Engineer with deep expertise in automation, infrastructure-as-code (IaC), and cloud platform management. You’ll design, deploy, and maintain robust cloud environments while collaborating with cross-functional teams to streamline CI/CD pipelines, enhance system reliability, and drive operational excellence. As a Cloud Infrastructure Engineer at LanceDB, your responsibilities will include: • Design & Build Cloud Infrastructure: Architect and manage secure, scalable cloud environments (AWS, Azure, GCP) using IaC tools like Terraform and CloudFormation. • Automate Everything: Develop and maintain automation scripts to streamline deployments, monitoring, and system operations. • Systems Reliability: Implement monitoring/alerting solutions (Prometheus, Grafana, Datadog) to proactively address performance bottlenecks and ensure 99.9% uptime. • Security & Compliance: Enforce security policies, manage secrets (Vault, AWS KMS), and ensure compliance with industry standards (GDPR, SOC2). • Troubleshoot & Optimize: Resolve complex infrastructure issues and lead cost-optimization initiatives for cloud resources. • Collaborate & Mentor: Partner with software engineering teams to integrate DevOps practices into SDLC and mentor junior engineers on IaC and cloud best practices. Requirements • 10+ years in DevOps, Cloud Infrastructure, or SRE roles, with hands-on experience in public cloud platforms (AWS, Azure, GCP, Heroku). • Strong experience operating and supporting production distributed systems and/or databases-as-a-service in a public cloud service provider, where it was the primary product for the company. This excludes being a user of an cloud service provider's database such as RDS or BigQuery. Bonus points for experience crafting multitenant solutions. This is a hard requirement; applicants without this experience will not qualify for this role. • Experience designing and managing complex production environments using Kubernetes and Helm. This is a hard requirement; applicants without this experience will not qualify for this role. • Expertise in IaC tools (Puppet, Terraform, Ansible, CloudFormation) and configuration management. • Deep understanding of networking, security, and cloud architecture best practices. • Experience with monitoring tools (Prometheus, Grafana) and logging systems (ELK, Splunk). • Strong knowledge of CI/CD tools (GitHub Actions) and containerization (Docker, Kubernetes). • You like working with a small, high-caliber team with a lot of autonomy and drive, and you can iterate fast Nice to have • You’ve made substantial contributions to open-source projects (e.g., Puppet modules, Terraform providers). • You design and automate single-command deployments for complex, globally distributed systems to ensure consistency, reliability, and scalability across multi-cloud or hybrid environments. • You fearlessly challenge the status quo and dismiss mediocre engineering as unacceptable. • You have worked on distributed large-scale systems, with a good understanding of how to using tracing tools to identify bottlenecks. • Experience building large-scale semantic search and/or caching systems is especially relevant. Why Join Us You’ll join a world-class team of open-source builders (co-authors of pandas, and contributors to HDFS, Arrow, Iceberg, and HBase) working on cutting-edge AI infrastructure. You’ll collaborate on systems that power next-generation AI workloads while shaping how LanceDB operates and scales production environments. Apply tot his job