335 jobs for "Machine Learning Evaluation Engineer"

AIML - Quality Engineering Manager, Responsible AI and Safety

At Apple - Cupertino

Posted on Oct 19

View job Apply on company site

Manufacturing Quality Engineering Intern, Brittles

At Apple - 深圳

Posted on Oct 17

View job Apply on company site

Engineering Program Manager, Data - Special Projects

At Apple - Cupertino

Posted on Oct 16

View job Apply on company site

Senior Manager, Data Science and Machine Learning

At Squarespace - New York City

Posted on Oct 14

View job Apply on company site

AIML - Applied AI Scientist, Image Autograder Systems, Evaluation

At Apple - Cupertino

Posted on Oct 8

View job Apply on company site

AIML - Machine Learning Manager, Red Teaming - Responsible AI and Safety

At Apple - San Francisco Bay Area

Posted on Oct 7

View job Apply on company site

Sr Data Scientist

At Northwestern Mutual – Corporate Careers - Milwaukee

Posted on Nov 7

View job Apply on company site

Principal Associate, Data Scientist - SBB Marketing & Deposit Strategy

At Capital One - McLean

Posted on Nov 7

View job Apply on company site

Principal Associate, Data Scientist -Financial Services-Consumer Risk Modeling

At Capital One - Plano

Posted on Nov 7

View job Apply on company site

Manager, Data Scientist - Business Cards & Payments

At Capital One - New York · McLean

Posted on Nov 7

View job Apply on company site

Manager, Data Scientist - SBB Marketing & Deposit Strategy

At Capital One - McLean

Posted on Nov 6

View job Apply on company site

Senior Manager, Data Science - Model Risk

At Capital One - McLean · Richmond

Posted on Nov 5

View job Apply on company site

Senior Manager, Data Science - Model Risk

At Capital One - Richmond · McLean

Posted on Nov 5

View job Apply on company site

Manager, Data Science - Emerging ML

At Capital One - McLean · San Jose

Posted on Nov 5

View job Apply on company site

Neural Graphics and World Models Research Scientist/Software Engineer Graduate (TikTok, Engine&Tools) - 2027 Start (PhD)

At TikTok - San Jose

Posted on Nov 2

View job Apply on company site

Senior Manager, Data Science - Model Risk

At Capital One - Richmond · New York

Posted on Nov 1

View job Apply on company site

Manager, Data Scientist -Financial Services- Pricing

At Capital One - Plano · McLean

Posted on Oct 30

View job Apply on company site

Principal Associate, Data Scientist - SBB Fraud

At Capital One - McLean

Posted on Oct 30

View job Apply on company site

Senior Manager, Data Science - US Card (Upmarket Segments)

At Capital One - Richmond · New York

Posted on Oct 29

View job Apply on company site

Risk Analyst

At TikTok - San Jose

Posted on Oct 28

View job Apply on company site

Apple

AIML - Quality Engineering Manager, Responsible AI and Safety

Cupertino, CA$267,800 – $401,700Posted 19 days ago

Apply on company site View full job

Why you should apply for a job to Apple:

Ranked as one of the Best Technology Companies in 2020
3.7/5 in overall job satisfaction
3.1/5 in supportive management
66% say women are treated fairly and equally to men
65% would recommend this company to other women
66% say the CEO supports gender diversity

Ratings are based on anonymous reviews by Fairygodboss members. See all reviews ›

Apple's Responsible AI and Safety team focuses on innovative technologies, methodologies, and research to enable fantastic user experiences and to push the frontier of machine learning. Our team is looking to hire a leader with a strong track record in Applied Research, who is passionate about ML and foundation models with a focus on responsibility, fairness, and safety. In this role, you will lead the research and application of ML methods for technologies that power breakthrough user experiences while upholding Apple's values, privacy, and quality standards.

Description

This role leads Apple's Quality Platform Engineering function within Responsible AI - the team responsible for giving engineering teams across Apple Intelligence fast, trustworthy safety signal before code merges, and for extending safety testing coverage to every hardware platform and form factor Apple ships. Most of this role's impact will come from two things: building a strong team and a healthy team culture from the ground up, and establishing the flywheel that connects Quality Platform Engineering to Product Evaluations & Research and Post-Ship Insights - so fast signal, coverage gaps, and pipeline improvements consistently translate into real engineering decisions and clear leadership visibility, rather than one-off dashboards nobody acts on.You should be technically fluent - comfortable with evaluation pipelines, production ML and agentic systems, and cross-platform testing - enough to earn credibility with the team, ask sharp questions, and evaluate hard tradeoffs with good judgment. This role moves at a fast pace, and you should be comfortable making product recommendations in ambiguous situations, often with limited or imperfect data. Just as important are excellent communication, strong product sense to prioritize a team's limited capacity against Apple's highest-risk platforms and use cases, and a track record of hiring and developing technical teams.Prior experience managing or building technical teams is required. Prior exposure to ML evaluation, test infrastructure, or safety-adjacent engineering work is strongly preferred.","responsibilities":"Hire, grow, and build the culture of a team spanning test engineering, applied ML, and platform-specific expertise

Own leadership reporting and safety sign-off representation for Quality Platform Engineering - translating pipeline health, coverage, and findings into risk and product terms for non-technical stakeholders

Set and continuously reprioritize which feature clusters, platforms, and hardware form factors the team covers, based on risk, launch timing, and known coverage gaps

Drive investment in test pipeline efficiency - turnaround time, infra cost, and flakiness - so pre-merge signal stays fast enough to be useful in the dev loop

Extend safety testing coverage beyond iPhone/iOS to every platform and device category Apple ships, partnering with platform teams to close hardware-specific gaps

Upstream trusted datasets for product-critical safety cases, so component teams have reliable ground truth to test against early

Champion shift-left safety testing - catching issues at the component level before they reach end-to-end evaluation

Stay technically fluent enough to evaluate findings, unblock the team on hard problems, and track how model and pipeline behavior shifts across releases

Ensure the team's signal stays consistent with Product Evaluations & Research's ship-time metrics, so pre-merge results reliably predict end-to-end outcomes rather than drifting from them

Manage occasional exposure to sensitive or policy-relevant content surfaced during testing, and support team wellbeing around that exposure

Preferred Qualifications

Experience working on Responsible AI, AI safety, or trust & safety-adjacent engineering

Experience with generative model evaluation and common failure modesStrong organizational and operational skills working with large, multi-functional, diverse teams

MS or PhD in Computer Science, Machine Learning, Statistics, or related field, or equivalent experience Familiarity with hardware/platform-specific testing considerations (e.g., on-device constraints, new form factors)

Minimum Qualifications

5+ years of technical team management or leadership experience

Experience with ML evaluation, production ML systems, or test/CI infrastructure at scale

Strong engineering skills and experience writing production-quality code (Python or similar)

Experience working across multiple platforms or hardware form factors, or a demonstrated ability to ramp quickly across unfamiliar platforms

Experience working with human-labeled or crowd-sourced evaluation data, including reasoning about label noise and inter-rater agreement

Pay & Benefits

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $267,800 and $401,700, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

About Apple

Working at Apple means doing more than you ever thought possible and having more impact than you ever imagined.

Size: 10,000+ employees
Industry: Technology: Manufacturing

View company profile