Posted in

Software Engineer – High Performance ML

Software Engineer – High Performance ML

CompanyCodeium
LocationMountain View, CA, USA
Salary$Not Provided – $Not Provided
TypeFull-Time
Degrees
Experience LevelMid Level

Requirements

  • Strong software engineering skills
  • Excellent quantitative, analytical and estimation skills
  • Strong grasp of computer and networking architecture, particularly with GPU hardware and HPC networks
  • Familiarity with AI-powered developer tools like Windsurf, Copilot, ChatGPT, and others is a strong plus

Responsibilities

  • Develop custom LLM serving systems and corresponding datacenter infrastructure to deliver high model quality at very low latency and cost
  • Improve our LLM training software both in terms of model architecture changes that improve model quality or increase iteration speed and reliability
  • Build indexing systems capable of serving queries instantly from many terabytes of data within customer deployments
  • Contribute to infrastructure for petabyte-scale data pipelines to accelerate our ML research work

Preferred Qualifications

  • Familiarity with AI-powered developer tools like Windsurf, Copilot, ChatGPT, and others is a strong plus