Job Description
Job Description
We’re hiring a Member of Technical Staff (Back-End / Systems) to join a small, deeply technical team building a next-generation platform for large-scale AI and LLM systems.
This role is ideal for an engineer who enjoys working close to the metal, cares deeply about performance and correctness, and wants to build infrastructure that other engineers rely on in production. Much of the work is open source and highly visible.
What You’ll Be Working On
You’ll help build and evolve a modern LLMOps and AI systems platform used by teams ranging from early-stage startups to large enterprises. The platform focuses on:
- Unified access to LLM providers via low-latency APIs
- Observability for AI systems (metrics, traces, debugging tools)
- Optimization pipelines for cost, latency, and quality
- Evaluation frameworks for individual inferences and end-to-end workflows
- Experimentation infrastructure (A/B testing, fallbacks, rollouts)
On top of this platform, the team is developing an automated AI engineering system that collaborates with engineers to analyze large volumes of inference data, recommend improvements, run experiments, and prevent regressions — all with full transparency and control.
Requirements
Core Requirements
- Strong background in back-end and systems engineering
- Experience building production systems that prioritize performance, reliability, and correctness
- Proficiency with systems programming languages such as Rust, C/C++, or Zig
- Comfort owning large technical projects from inception to deployment