About Realm LabsRealm Labs is building the infrastructure that makes AI safe for enterprises. Our platform helps organizations securely deploy, monitor, and govern AI applications through real-time detection, policy enforcement, and security controls.Our systems process billions of AI tokens across production workloads and solve challenging problems in distributed systems, inference infrastructure, security, and developer tooling.We’re a small, engineering-driven team where every engineer owns meaningful pieces of the product and works directly with customers.
What You’ll DoAs a Software Engineer at Realm Labs, you’ll build production systems that power enterprise AI deployments. Your work will span backend services, distributed systems, infrastructure, and customer-facing features.Responsibilities include:
- Design and build scalable backend services in Python or Go.
- Develop APIs and internal services used by enterprise customers.
- Work with distributed systems, asynchronous processing, and message queues.
- Design efficient database schemas and optimize query performance.
- Build reliable integrations with cloud services and AI platforms.
- Debug production issues and improve system reliability and observability.
- Collaborate closely with product, infrastructure, and AI engineers to ship features quickly.
- Participate in code reviews and help maintain a high engineering bar.
What We’re Looking For
- 2+ years of professional software engineering experience.
- Bachelors of Science in Computer Science or equivalent degrees.
- Strong programming skills in Python, Go, Java, C++, or a similar language.
- Solid understanding of computer science fundamentals, including:
- Data structures and algorithms
- Operating systems
- Concurrency and multithreading
- Experience designing and consuming REST or gRPC APIs.
- Experience working with relational databases such as PostgreSQL or MySQL.
- Understanding of distributed systems concepts such as replication, consistency, caching, partitioning, queues, and fault tolerance.
- Experience with cloud platforms (AWS, GCP, or Azure).
- Strong debugging and problem-solving skills.
- Excellent communication skills and ability to work in a fast-moving startup.
Nice to Have
- Experience building distributed systems at scale.
- Experience with Docker and Kubernetes.
- Familiarity with Redis, RabbitMQ, Kafka, or similar technologies.
- Experience with observability tools (OpenTelemetry, Prometheus, Grafana).
- Experience with AI/LLM infrastructure.
- Experience working in startups or shipping customer-facing products.
Technologies We UseYou don’t need experience with everything below, but you’ll likely work with many of them:
- Python
- Go
- PostgreSQL
- Redis
- Docker & Kubernetes
- AWS, GCP, Azure
- FastAPI
- Terraform
- GitHub Actions
- OpenTelemetry
- LLM APIs and inference infrastructure
What We ValueWe’re looking for engineers who:
- Take ownership from idea to production.
- Care about writing clean, maintainable code.
- Think systematically about reliability and scalability.
- Enjoy learning new technologies.
- Move quickly without sacrificing quality.
- Are excited about building products in the AI infrastructure and security space.
Why Join Realm Labs?
- Build foundational infrastructure for the next generation of AI applications.
- Solve challenging distributed systems and infrastructure problems.
- Work directly with experienced engineers from companies like Google, Apple, Microsoft, and leading security organizations.
- High ownership with significant impact from day one.
- Competitive salary and meaningful equity.
- Opportunity to help define the future of enterprise AI security.
Required skills
- Grafana
- Prometheus
- Terraform
- Security Policies and Procedures
- Identifying Problems
- Production Systems
- Operating System
- Fault Tolerance
- MySQL
- Code Review
- Software engineering
- Data Structure and Algorithms (DSA)
- Relational Database Experience
- Java
- C++
- Python
- New Technologies
- Multi-Threading
- Debugging
- Representational State Transfer (REST)
- PostgreSQL
- Windows Azure
- Redis