Engineering Manager, Inference Infrastructure at anthropic
Company: anthropic
Location: San Francisco, CA | New York City, NY | Seattle, WA
Workplace: On-site
Seniority: Mid-level
Category: Engineering · software engineer
Compensation: ~£320k–£494k
Posted: 2026-09-01
Stack: rust, go, kubernetes, aws, ML, llm, react
Role overview
Every request that hits Claude — from claude.ai , the API, our cloud partners, or internal research — depends on a set of decisions made before it ever reaches a model: where each request should be served and how much capacity each model needs right now. Getting those decisions right is crucial to satisfying throughput, reliability, and latency constraints. This group builds the control plane that makes those decisions for Anthropic's inference fleet and own the inference…