Member of Technical Staff, Performance and Scale
Read straight from Inferact's careers page, verified 3d ago.Seekless can tailor your résumé to it.
Seekless can write your résumé for this posting first.
Before you apply
Salary$200k – $400k
LocationSan Francisco
Also inremote in the US
Work modeon-site
Typefull-time
SeniorityLead
DepartmentResearch & Engineering
EquityIncluded
Company size51–200 people
PostedJan 22, 2026 · 9mo ago
Verified live3d ago
At a glanceSummarised by Seekless from the posting.
Bachelor's degree or equivalent experience in computer science, engineering, or similar
Strong systems programming skills in Rust, Go, or C++
Experience designing and building high-performance distributed systems at scale
Understanding of network protocols and high-performance I/O
Ability to debug complex distributed systems issues
Experience with ML serving infrastructure and disaggregated inference architecture
Familiarity with GPU programming models and memory hierarchies
Knowledge of GPU interconnects (NVLink, InfiniBand, RoCE) and their performance characteristics
Track record of improving system reliability and performance at scale
Prior experience in supporting large-scale model training or inference environments
We sponsor visas on a case-by-case basis
Skills
Rust
Go
C++
NVLink
InfiniBand
RoCE
Benefits
Health insurance
Dental insurance
Vision insurance
401(k)
About the company
Inferact’s mission is to grow vLLM as the world’s AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build.
About the Role
We’re looking for an infrastructure engineer to build the distributed systems that power inference at global scale. You’ll design and implement the foundational layers that enable vLLM to serve models across thousands of accelerators with minimal latency and maximum reliability. Tomorrow, deploying a frontier model at scale should be as straightforward as spinning up a serverless database. The complexity doesn’t disappear as it gets absorbed into the infrastructure you’re building.
Skills and Qualifications
Minimum qualifications:
•
Bachelor’s degree or equivalent experience in computer science, engineering, or similar.
•
Strong systems programming skills in Rust, Go, or C++.
•
Experience designing and building high-performance distributed systems at scale.
•
Understanding of network protocols and high-performance I/O.
•
Ability to debug complex distributed systems issues.
Preferred qualifications:
Nice to have
•
Experience with ML serving infrastructure and disaggregated inference architecture.
•
Familiarity with GPU programming models and memory hierarchies.
•
Knowledge of GPU interconnects (NVLink, InfiniBand, RoCE) and their performance characteristics.
•
Track record of improving system reliability and performance at scale.
Bonus points if you have:
•
Prior experience in supporting large‑scale model training or inference environments.
Logistics
•
Location: This role is based in San Francisco, California. Will consider remote in the US for exceptional candidates.
•
Compensation: Depending on background, skills, and experience, the expected annual salary range for this position is $200,000 - $400,000 USD + equity.
•
Visa sponsorship: We sponsor visas on a case-by-case basis.
•
Benefits: Inferact offers generous health, dental, and vision benefits as well as 401(k) company match.