Job Description
Job DescriptionInfrastructure Engineer
San Francisco, CA · On-site · Full-time
Compensation: $150,000–$250,000 + up to 1% equity
About the Company
A seed-stage LLM interpretability and context-optimization company building custom machine learning models that analyze and compress token contexts before they reach the underlying model — delivering roughly 50% inference cost reduction, lower latency, and higher accuracy for the enterprises and scale-ups integrating LLMs into their products. Venture-backed, with strong early traction (~1,000 customers within its first seven months).
Founded 2025 · 1–10 people · Industry: AI Tools / LLM infrastructure
The Role
Own the full multi-region GPU infrastructure stack end to end as the sole infra hire — global low-latency serving, multi-cloud and on-premise deployments, reliability, and cost efficiency. Your work sits directly in the critical path of live customer traffic. This is a high-ownership, in-person role at a fast-moving early-stage team, working a 996 pace (9am–9pm, six days a week) in San Francisco.
What you'll be doing
- Own the full infrastructure stack end to end across multi-region GPU deployments, major public clouds, and on-premise enterprise environments.
- Build and maintain super low-latency GPU serving infrastructure that sits in the critical path of live customer traffic.
- Manage multi-cloud deployments, including cloud marketplace integrations and provider relationships.
- Design and iterate on deployment, scaling, reliability, and cost-efficiency systems as the sole infra owner.
- Support on-premise deployments for enterprise clients and ensure performance and reliability at each site.
- Research and adopt new infrastructure solutions continuously as the stack and customer base grow.
Tech stack: AWS, GCP, Terraform, Docker, CI/CD, GPU/ML inference infrastructure
Requirements
- Own cloud systems serving compression API end-to-end
- Build and operate global low-latency high-throughput GPU ML inference infrastructure
- Work with AWS, Terraform, Docker and CI/CD
- Have built and operated production infrastructure at a startup or larger company
- Learn new solutions and technologies quickly
- Improve and research infrastructure solutions continuously
- Based in or willing to relocate to San Francisco to work in person at the hacker house
- Willingness to work startup hours in a 996-style environment (9am–9pm, six days a week)
Green Flags
- Quick learner who grasps products and systems fast
- Experience building for performance and reliability at scale
- Research and product focus mindset
- High ownership mentality
- Startup-minded operator who prioritizes learning and growth over work-life balance
- GPU infrastructure experience in production
- First infra hire at a startup
- Background at an infrastructure company
Red Flags
- Infra scope limited to model training pipelines only
- 20+ years of experience with a slow-moving, process-heavy background
- Prioritizes work-life balance as a primary requirement
- No production infra ownership
Why Join
- Sole infra owner with full-stack ownership from day one, directly in the critical path of live customer traffic.
- Well-funded seed-stage company with strong early traction and an experienced backer base.
- Significant equity, housing and food provided at the SF hacker house, visa sponsorship, laundry and cleaning, company off-sites, infinite DoorDash, and health & dental.
Details
- Location: San Francisco, CA
- Work policy: In person (SF hacker house); 996 pace — 9am–9pm, six days a week
- Compensation: $150,000–$250,000 + up to 1% equity
- Visa sponsorship: Available (H-1B, O-1, OPT)
- Employment type: Full-time