[Remote] Principal Site Reliability Engineer
Note: The job is a remote job and is open to candidates in USA. Upstart is a leading AI lending marketplace on a mission to reduce the cost and complexity of borrowing for all Americans. They are seeking a Principal Site Reliability Engineer to lead the SRE team in ensuring the reliability and observability of their production systems while driving best practices and collaborating with cross-functional teams to enhance operational excellence.
Responsibilities
ā¢ Lead the definition, advocacy, and adoption of SRE principles across engineering teams
ā¢ Partner with leadership to shape long-term reliability, resiliency, and observability strategies
ā¢ Champion distributed tracing, real user monitoring (RUM), and key performance metrics such as Largest Contentful Paint (LCP) to improve system visibility and user experience
ā¢ Build and scale self-healing systems to minimize manual intervention and reduce downtime
ā¢ Drive enterprise-wide improvements to incident response processes, including those related to Machine Learning systems
ā¢ Collaborate closely with Development Productivity and Quality teams to improve engineering velocity without sacrificing reliability
ā¢ Influence technical and operational roadmaps through data-driven insights and hands-on technical contributions
ā¢ Own and deliver cross-functional initiatives from concept through execution, applying program management skills to align stakeholders and achieve results
Skills
ā¢ Bachelor's degree in Computer Science, Engineering, or Mathematics, or a related field (or its equivalent) + 8 years of experience
ā¢ Combined experience with both Software Engineering and Site Reliability Engineering, with a balanced background in both disciplines
ā¢ Proven track record as an SRE thought leader and evangelist, driving adoption of reliability best practices across organizations
ā¢ Strong communication and mentoring skills to influence engineers across disciplines
ā¢ Proficiency in Python, Go, JavaScript/TypeScript
ā¢ Proficiency with Infrastructure as Code (Terraform, CDK, CloudFormation, etc.)
ā¢ Experience building internal tooling from scratch in agile development environments
ā¢ Expertise with observability, distributed tracing, RUM, LCP, and performance monitoring tools (e.g., Datadog, Prometheus)
ā¢ Experience with on-call and incident management, including large-scale or ML-related incidents
ā¢ Strong background in automation and building self-healing systems
ā¢ Hands-on experience with LLM/GenAI to improve SRE efficiency and processes
ā¢ Program management skills, including the ability to propose innovative solutions, influence leadership, improve processes, and drive cross-functional projects to completion
ā¢ Experience with service mesh
ā¢ Full stack development skills
ā¢ Experience building or extending observability platforms
ā¢ Background in Development Productivity or Quality Platforms
ā¢ Experience in high-scale SaaS, microservice-oriented cloud environments
Benefits
ā¢ Target bonuses
ā¢ Equity compensation
ā¢ Generous benefits packages (including medical, dental, vision, and 401k)
ā¢ Competitive compensation, including base pay, bonus opportunities, and annual equity grants that vest quarterly
ā¢ Retirement benefits to help you plan for the future, including a 401(k) or Group Retirement Savings Plan with a company match of $2 for every $1 contributed, up to $15,000 annually (USD in the US, CAD in Canada)
ā¢ Employee Stock Purchase Plan (ESPP) with discounted stock purchase options for eligible employees (US only)
ā¢ Comprehensive health coverage designed to support you and your family, including medical, dental, vision, and wellness resources for US and supplemental health coverage for Canada.
ā¢ Health Savings Account contributions from Upstart for eligible plans (US only)
ā¢ Income protection benefits, including life insurance and disability coverage for added financial security
ā¢ Paid time off, sick leave, and company holidays, in line with local requirements
ā¢ Paid family and parental leave to support caregiving and major life moments (duration varies by country)
ā¢ Family-centered benefits to support fertility, parenthood, and caregiving needs
ā¢ Employee Assistance Program (EAP) offering mental health support and life-centered resources
ā¢ Financial wellness resources, including access to financial planning tools and a financial concierge service (US Only)
ā¢ Annual wellness allowance to support your physical and emotional well-being and personal development, based on what matters most to you
ā¢ Annual productivity allowance to invest in relevant tools and resources you need to do your best work, no matter where you work from
ā¢ Connection and community through team events, a
Responsibilities
ā¢ Lead the definition, advocacy, and adoption of SRE principles across engineering teams
ā¢ Partner with leadership to shape long-term reliability, resiliency, and observability strategies
ā¢ Champion distributed tracing, real user monitoring (RUM), and key performance metrics such as Largest Contentful Paint (LCP) to improve system visibility and user experience
ā¢ Build and scale self-healing systems to minimize manual intervention and reduce downtime
ā¢ Drive enterprise-wide improvements to incident response processes, including those related to Machine Learning systems
ā¢ Collaborate closely with Development Productivity and Quality teams to improve engineering velocity without sacrificing reliability
ā¢ Influence technical and operational roadmaps through data-driven insights and hands-on technical contributions
ā¢ Own and deliver cross-functional initiatives from concept through execution, applying program management skills to align stakeholders and achieve results
Skills
ā¢ Bachelor's degree in Computer Science, Engineering, or Mathematics, or a related field (or its equivalent) + 8 years of experience
ā¢ Combined experience with both Software Engineering and Site Reliability Engineering, with a balanced background in both disciplines
ā¢ Proven track record as an SRE thought leader and evangelist, driving adoption of reliability best practices across organizations
ā¢ Strong communication and mentoring skills to influence engineers across disciplines
ā¢ Proficiency in Python, Go, JavaScript/TypeScript
ā¢ Proficiency with Infrastructure as Code (Terraform, CDK, CloudFormation, etc.)
ā¢ Experience building internal tooling from scratch in agile development environments
ā¢ Expertise with observability, distributed tracing, RUM, LCP, and performance monitoring tools (e.g., Datadog, Prometheus)
ā¢ Experience with on-call and incident management, including large-scale or ML-related incidents
ā¢ Strong background in automation and building self-healing systems
ā¢ Hands-on experience with LLM/GenAI to improve SRE efficiency and processes
ā¢ Program management skills, including the ability to propose innovative solutions, influence leadership, improve processes, and drive cross-functional projects to completion
ā¢ Experience with service mesh
ā¢ Full stack development skills
ā¢ Experience building or extending observability platforms
ā¢ Background in Development Productivity or Quality Platforms
ā¢ Experience in high-scale SaaS, microservice-oriented cloud environments
Benefits
ā¢ Target bonuses
ā¢ Equity compensation
ā¢ Generous benefits packages (including medical, dental, vision, and 401k)
ā¢ Competitive compensation, including base pay, bonus opportunities, and annual equity grants that vest quarterly
ā¢ Retirement benefits to help you plan for the future, including a 401(k) or Group Retirement Savings Plan with a company match of $2 for every $1 contributed, up to $15,000 annually (USD in the US, CAD in Canada)
ā¢ Employee Stock Purchase Plan (ESPP) with discounted stock purchase options for eligible employees (US only)
ā¢ Comprehensive health coverage designed to support you and your family, including medical, dental, vision, and wellness resources for US and supplemental health coverage for Canada.
ā¢ Health Savings Account contributions from Upstart for eligible plans (US only)
ā¢ Income protection benefits, including life insurance and disability coverage for added financial security
ā¢ Paid time off, sick leave, and company holidays, in line with local requirements
ā¢ Paid family and parental leave to support caregiving and major life moments (duration varies by country)
ā¢ Family-centered benefits to support fertility, parenthood, and caregiving needs
ā¢ Employee Assistance Program (EAP) offering mental health support and life-centered resources
ā¢ Financial wellness resources, including access to financial planning tools and a financial concierge service (US Only)
ā¢ Annual wellness allowance to support your physical and emotional well-being and personal development, based on what matters most to you
ā¢ Annual productivity allowance to invest in relevant tools and resources you need to do your best work, no matter where you work from
ā¢ Connection and community through team events, a