Principal Site Reliability Engineer, Infrastructure Observability

Job Description

Our client is seeking a Principal Site Reliability Engineer, Infrastructure Observability to help build and advance a world-class SRE function focused on observability, reliability, scalability, resilience, and automation across complex cloud and on-premises environments. This role will be instrumental in driving operational excellence through modern engineering practices, automation, and best-in-class observability tooling.

\n

The ideal candidate brings deep expertise in cloud infrastructure, DevOps, SRE methodologies, incident management, automation, and infrastructure monitoring. They will serve as a strategic leader and hands-on technical expert, helping shape reliability practices across a highly distributed enterprise environment.

\n

\n

Responsibilities:

\n

\n
• Lead the design and implementation of reliability-focused solutions that improve system availability and minimize service disruptions.

\n

• Drive SRE best practices across the organization, promoting a culture of automation, operational excellence, and continuous improvement.

\n

• Champion observability initiatives, including monitoring, alerting, logging, and application performance management (APM).

\n

• Conduct incident trend analysis and lead initiatives to reduce recurring technology failures.

\n

• Facilitate blameless post-mortems and reliability reviews to strengthen operational maturity.

\n

• Develop automated solutions to proactively prevent incidents and accelerate remediation efforts.

\n

• Create unified visibility across technology platforms to identify risks, redundancies, and optimization opportunities.

\n

• Partner with engineering, infrastructure, security, and business stakeholders to improve service reliability and operational performance.

\n

• Contribute to target-state architecture and the long-term evolution of the technology ecosystem.

\n

• Mentor engineers and help establish standards, frameworks, and operational practices across the organization.

\n

\n

\n

Requirements:

\n

\n
• Bachelor's degree or equivalent combination of education and experience.

\n

• 10+ years of experience designing, building, and operating enterprise infrastructure solutions with significant organizational impact.

\n

• 5+ years of hands-on experience with Amazon Web Services (AWS).

\n

• 5+ years building, leading, or supporting Site Reliability Engineering (SRE) and/or DevOps functions.

\n

• Experience implementing and operating chaos engineering practices at scale.

\n

• Proven success leading strategic technology and transformation initiatives.

\n

• Strong scripting, systems administration, and infrastructure automation experience.

\n

• Demonstrated ability to leverage automation to improve reliability and reduce operational risk.

\n

• Proficiency in multiple programming languages, including Python, Java, Go, Node.js, and/or .NET Core.

\n

• Strong database experience with SQL Server, PostgreSQL, MySQL, or similar platforms.

\n

• Deep understanding of Service Level Indicators (SLIs), Service Level Objectives (SLOs), availability metrics, and reliability measurement frameworks.

\n

• Experience implementing and managing Error Budgets.

\n

• Strong incident response, root cause analysis, and service recovery expertise.

\n

• Experience standardizing observability, monitoring, logging, and dashboarding across enterprise environments.

\n

• Hands-on experience with tools such as New Relic, Splunk, Elastic Stack, Prometheus, Grafana, SolarWinds, and cloud-native monitoring platforms.

\n

• Experience with infrastructure automation and cloud management tools including Terraform, Ansible, Vault, and Vagrant.

\n

• Ability to influence stakeholders across technical and business teams.

\n

• Strong communication, leadership, and mentoring skills.

\n

• Willingness to participate in on-call rotations and support critical production environments.

\n

\n

\n

Preferred Qualifications

\n

\n
• Cloud, DevOps, or Site Reliability Engineering certifications.

\n

• Working knowledge of Microsoft Azure.

\n

• Experience within highly regulated, large-scale enterprise environments.

\n

\n

\n

Why Apply?

\n

This is an opportunity to play a pivotal role in shaping the reliability, observability, and operational excellence strategy for a leading enterprise technology organization. You'll work alongside senior engineering leaders, influence large-scale technology initiatives, and drive the adoption of modern SRE practices across a complex global environment.