1,563 jobs for "Strategy Execution Lead"

Evaluation Science Lead

At Apple - Austin

Posted on Oct 15

View job Apply on company site

ASIC Design Engineering Lead - SoC IP DMA

At Apple - Sunnyvale

Posted on Oct 8

View job Apply on company site

Product & Process Solution Program Management Lead - Live & Monetization

At TikTok

Posted on Oct 6

View job Apply on company site

Channel and Partner Communications Lead,

At Apple - Mumbai

Posted on Oct 3

View job Apply on company site

Product Lead, Minor Feed Safety

At TikTok - San Jose

Posted on Sep 18

View job Apply on company site

Global Client Lead, FBA & QSR, Global Accounts

At TikTok - New York

Posted on Sep 18

View job Apply on company site

Automotive KA Operations Specialist (Lead Generation) - TikTok LIVE

At TikTok - Los Angeles

Posted on Sep 15

View job Apply on company site

UK Business Planning Strategy Intern (TikTok Shop) - 2027 Summer

At TikTok - London

Posted on Aug 22

View job Apply on company site

TikTok Shop - Business Management Strategy Manager - Germany

At TikTok - Düsseldorf

Posted on Jul 30

View job Apply on company site

Head of North America Product Strategy & Operations - Global Business Solutions

At TikTok - San Jose

Posted on Jul 23

View job Apply on company site

Head of North America Product Strategy & Operations - Global Business Solutions

At TikTok - New York

Posted on Jul 23

View job Apply on company site

Business Strategy Manager, SEA

At TikTok

Posted on Feb 2

View job Apply on company site

Maintenance Team Lead

At Altria Group, Inc. - Richmond

Posted on Nov 6

View job Apply on company site

Manager, Product Management- Data Capabilities

At Capital One - McLean · New York

Posted on Nov 8

View job Apply on company site

Regional Director, Digital Assets Sales & Commercialization, North America

At Mastercard - San Carlos

Posted on Nov 7

View job Apply on company site

Merchant Services Business Development - Business Banking

At PNC Financial Services Group - Philadelphia

Posted on Nov 7

View job Apply on company site

Managing Consultant, Services Business Development

At Mastercard - Greater London

Posted on Nov 6

View job Apply on company site

Senior Brand Manager - Rum

At Diageo - Budapest

Posted on Nov 5

View job Apply on company site

Manager, VM-Extended Operations (Hybrid)

At Capital One - Richmond · McLean

Posted on Nov 5

View job Apply on company site

TikTok Shop - Sorting Equipment Implementation & Operations Manager, Sort Centers

At TikTok

Posted on Nov 4

View job Apply on company site

Apple

Evaluation Science Lead

Austin, TX$175,500 – $311,700Posted 24 days ago

Apply on company site View full job

Why you should apply for a job to Apple:

Ranked as one of the Best Technology Companies in 2020
3.7/5 in overall job satisfaction
3.1/5 in supportive management
66% say women are treated fairly and equally to men
65% would recommend this company to other women
66% say the CEO supports gender diversity

Ratings are based on anonymous reviews by Fairygodboss members. See all reviews ›

The people here at Apple don't just create products - they create the kind of wonder that's revolutionized entire industries. It's the diversity of those people and their ideas that inspires the innovation that runs through everything we do. Join Apple, and help us leave the world better than we found it.

We are looking for an Evaluation Science Lead to define how our multilingual Globalization AI solutions are measured and validated across Apple Services - including Apple Music, App Store, Apple TV+, Apple Podcasts, and more. This is a rare opportunity to build evaluation science as a discipline at the intersection of language, culture, and AI, and to directly shape whether hundreds of millions of users around the world feel genuinely at home in Apple's products.

Description

Language carries culture, nuance, and context - as Evaluation Science Lead, you will own the scientific rigor behind measuring how our AI-powered Globalization solutions perform across 50+ languages and dozens of markets. As a strategic individual contributor on the Globalization Quality and Operations team, you will design statistically grounded evaluation frameworks combining human judgment with scalable automation - partnering with Engineering, AI Strategy, and Production to turn evaluation into a strategic capability.

This role requires strong analytical and scientific thinking, hands-on execution, and sound judgment to communicate complex findings clearly. You thrive in ambiguity and know evaluation delivers value only when operationalized - if you believe rigorous, culturally-informed evaluation is one of the highest-leverage ways to improve AI language quality globally, this role was built for you.","responsibilities":"Framework & Methodology Design

Define the long-term evaluation science strategy and roadmap for Globalization AI solutions across 50+ languages, including targeted approaches for low-resource locales.

Design robust statistical methodologies-including power analysis, sampling, confidence intervals, and significance thresholds-to evaluate models with scientific validity.

Architect scalable evaluation workflows blending human annotation (calibration, protocols, inter-annotator agreement) with automated systems (autograders, LLM-as-judge, and agent-based first-pass scoring).

Expand evaluation criteria beyond core linguistic quality to incorporate behavioral and user engagement signals.

Insights & Continuous Improvement

Translate complex evaluation data and loss patterns into clear, actionable recommendations and go/no-go evidence for Engineering and leadership.

Build continuous performance monitoring and drift-detection systems to distinguish real regressions from measurement noise.

Establish feedback loops with Quality Operations and Engineering to rapidly refine evaluation rubrics as models evolve.

Serve as the resident authority on multilingual AI evaluation, communicating methodologies and upleveling best practices across Globalization Apple Services.

Preferred Qualifications

Master's, PhD, or comparable experience in Statistics, Computational Linguistics, Computer Science, Psychometrics, Data Science, or related quantitative field.

Experience evaluating generative AI systems-including hallucination detection, safety and cultural alignment, autograders / LLM-as-judge systems, benchmark design, and synthetic data evaluation.

Experience with A/B testing, causal inference, or experimental design

Experience in applied linguistics - translating cultural and linguistic nuances into quantitative evaluation framework

Minimum Qualifications

5+ years of experience in evaluation science, data science, or ML systems development, with demonstrated experience owning evaluation systems at scale end-to-end

Experience applying statistical methodology - sampling, significance testing, and confidence intervals

Practical understanding of measurement validity principles

Hands-on experience measuring annotator agreement, diagnosing divergence, and improving annotation protocols

Proficiency with statistical tools and languages (R, Python, SQL) for analysis and reproducibility

Experience designing evaluation frameworks adopted and scaled by operational teams

Strong written and verbal communication skills for technical and non-technical audiences

Direct experience handling sensitive and confidential information with integrity and discretion

Ability to be onsite; this role is an in-person, onsite position

Availability to work occasional evenings and weekends, as business needs require

Up to 10% + travel; both domestic and international

Pay & Benefits

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $175,500 and $311,700, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

About Apple

Working at Apple means doing more than you ever thought possible and having more impact than you ever imagined.

Size: 10,000+ employees
Industry: Technology: Manufacturing

View company profile