Skip to content
Senior Staff Software Engineer – Managed AI
| Company | Crusoe |
|---|
| Location | San Francisco, CA, USA |
|---|
| Salary | $290000 – $290000 |
|---|
| Type | Full-Time |
|---|
| Degrees | Master’s |
|---|
| Experience Level | Senior, Expert or higher |
|---|
Requirements
- Advanced degree in Computer Science, Engineering, or a related field.
- Demonstrable experience in distributed systems design and implementation.
- Proven track record of delivering early-stage projects under tight deadlines.
- Expertise in using cloud-based services, such as elastic compute, object storage, virtual private networks, managed database, etc.
- Experience in Generative AI (Large Language Models, Multimodal).
- Familiarity with AI infrastructure, including training, inference, and ETL pipelines.
- Experience with container runtimes (e.g., Kubernetes) and microservices architectures.
- Experience using REST APIs and common communication protocols, such as gRPC.
- Demonstrated experience in the software development cycle and familiarity with CI/CD tools.
Responsibilities
- Lead the design and implementation of core AI services, including resilient fault-tolerant queues, model catalogs, scheduling mechanisms, and high-performance APIs.
- Build and scale infrastructure to handle millions of API requests per second.
- Optimize AI inference performance on GPU-based systems.
- Implement robust monitoring and alerting to ensure system health and availability.
- Collaborate closely with product management, business strategy, and other engineering teams.
- Influence the long-term vision and architectural decisions of the AI platform.
- Contribute to open-source AI frameworks and participate in the AI community.
- Prototype and iterate on new features and technologies.
Preferred Qualifications
- Proficiency in Golang or Python for large-scale, production-level services.
- Contributions to open-source AI projects such as VLLM or similar frameworks.
- Performance optimizations on GPU systems and inference frameworks.
