Posted in

Aiml – Senior Machine Learning Engineer – ML Systems Evaluation Engineering

Aiml – Senior Machine Learning Engineer – ML Systems Evaluation Engineering

CompanyApple
LocationSeattle, WA, USA
Salary$239700 – $360200
TypeFull-Time
DegreesMaster’s, PhD
Experience LevelExpert or higher

Requirements

  • 10+ years of professional work experience applying machine learning to real-world problems and crafting scalable and effective data solutions, including demonstrated contributions towards the development of natural language products and/or technologies
  • Experience with managing datasets for ML training and/or evaluation
  • MS/PhD in Machine Learning, Computer Science, or equivalent experience in a related field
  • Excellent programming skills in Python

Responsibilities

  • Deliver offline evaluation insights that drive model development and improvements with wins for end-user experience
  • Collaborate closely with cross-functional teams to lead the creation and evolution of high-quality datasets for evaluation of state-of-the-art models
  • Develop representative datasets for delivering a highly personalized user experience

Preferred Qualifications

  • Good Conversational AI domain knowledge
  • Experience working with end-to-end pipelines and/or crowd-sourced data labeling
  • Excellent problem solving, critical thinking, and communication skills
  • Expertise in defining and measuring evaluation coverage for large language models and agents
  • Enthusiasm and ability for continuing to learn new technologies
  • Experience with systems engineering; in-depth understanding of interdependencies of ML and SW components
  • Excellent understanding of an ML-based product lifecycle
  • Experience delivering large-scale, cross-functional product or platform outcomes