737 jobs for "Senior AI Engineer"

Business Analytics Consultant Senior - C&IB Data Analytics

At PNC Financial Services Group - Pittsburgh

Posted on Nov 7

View job Apply on company site

Senior Information Security (Application Security)

At TD Bank - Toronto

Posted on Nov 5

View job Apply on company site

Business Analytics Consultant Senior - C&IB Data Analytics

At PNC Financial Services Group - Pittsburgh

Posted on Nov 5

View job Apply on company site

Senior Staff Techno functional Business Analyst Duck Creek

At The Hartford - Hyderabad

Posted on Nov 5

View job Apply on company site

Senior Manager, Product Management - Consumer & Developer Experience (Marketing Journey Platforms Lead)

At Capital One - New York · Richmond

Posted on Nov 5

View job Apply on company site

Senior Director, Strategic Partnerships

At Spectrum - Greenwood Village

Posted on Nov 5

View job Apply on company site

Senior, 3D Designer, Innovation

At Nike - Beaverton

Posted on Nov 4

View job Apply on company site

Senior Manager, Product Management- Data Product Interface on GraphQL

At Capital One - Richmond · McLean

Posted on Nov 1

View job Apply on company site

Senior Manager Enterprise SaaS Sales - Capital One Software (Remote)

At Capital One - Remote / Flexible

Posted on Oct 31

View job Apply on company site

Senior Lead Program Manager, Client Project Delivery - Professional Consulting Services (RapidScale) (Remote)

At Spectrum - Remote / Flexible

Posted on Oct 28

View job Apply on company site

Senior Lead Program Manager, Client Project Delivery - Professional Consulting Services (RapidScale) (Remote)

At Spectrum - Remote / Flexible

Posted on Oct 28

View job Apply on company site

Senior Lead Program Manager, Client Project Delivery - Professional Consulting Services (RapidScale) (Remote)

At Spectrum - Remote / Flexible

Posted on Oct 28

View job Apply on company site

Principal Product Manager - Conversational AI

At Equinix - Remote / Flexible

Posted on Oct 27

View job Apply on company site

Senior Manager, Tech Risk & Analysis - Strategic Tech Risk Advisor

At Capital One - Plano

Posted on Oct 24

View job Apply on company site

Observability SRE Manager, Apple Services Engineering

At Apple

Posted on Oct 19

View job Apply on company site

Senior Product Manager, Apple AIML

At Apple - Cupertino

Posted on Oct 19

View job Apply on company site

Senior Analyst Product Manager - Enterprise Data Enablement

At Mastercard - Bogotá

Posted on Oct 19

View job Apply on company site

Senior Director, Product Management - Developer Telemetry

At Capital One - McLean · Richmond

Posted on Oct 19

View job Apply on company site

Research Scientist, AI Evaluation Science

At Apple - Seattle

Posted on Oct 17

View job Apply on company site

Observability SRE Manager, Apple Services Engineering

At Apple - Seattle

Posted on Oct 17

View job Apply on company site

Apple

Research Scientist, AI Evaluation Science

Seattle, WA$205,400 – $308,500Posted 23 days ago

Apply on company site View full job

Why you should apply for a job to Apple:

Ranked as one of the Best Technology Companies in 2020
3.7/5 in overall job satisfaction
3.1/5 in supportive management
66% say women are treated fairly and equally to men
65% would recommend this company to other women
66% say the CEO supports gender diversity

Ratings are based on anonymous reviews by Fairygodboss members. See all reviews ›

AI systems are only as trustworthy as the methods used to evaluate them. At Apple, where AI powers experiences for billions of people, getting evaluation right is not a support function-it is a foundational science. Our team, part of Apple Services Engineering, is building that scientific foundation: rigorous, scalable evaluation methodology for LLMs, agentic systems, and human-AI interaction.

What makes this team unusual is its interdisciplinary core. You will work alongside measurement scientists (psychometrics, validity theory), ML researchers, and platform engineers-bringing together ML research, statistical rigor, and production engineering.

We are looking for a Research Scientist who treats evaluation methodology itself as a first-class research problem-someone with deep technical fluency in preference learning, reward modeling, or calibration theory, and the drive to advance the field while solving real problems at scale. We're hiring at multiple levels (early-career to senior researchers). What unites all candidates is depth of thinking about evaluation as a research problem.

Description

This is primarily a research role. You will formulate open problems in evaluation science, design experiments, publish findings, and drive projects from conception through completion. While you will also partner with platform engineers to ensure your methods are productionized into SDKs and APIs, the focus of the role is original research.

Our research team brings together ML scientists and measurement scientists to tackle evaluation as both a machine learning and a measurement problem, building methods that are technically innovative and scientifically valid. You will also work closely with a platform engineering team that translates research into production-ready SDKs and APIs used across Apple.

The successful candidate will have a strong publication record in evaluation-adjacent ML areas and a demonstrated ability to implement complex methods from recent papers, run large-scale experiments, and communicate results to both technical and non-technical audiences.","responsibilities":"Advance evaluation methodology through original research in one or more of the following areas: preference learning and reward modeling (RLHF, DPO, reward hacking mitigation); LLM-as-judge calibration, rubric design, and bias detection; intelligent evaluation strategies including active learning for test selection and automated failure discovery; or validity frameworks for evaluators (construct validity, transfer learning). You are not expected to cover all of these-depth matters more than breadth.

Publish at top-tier venues (NeurIPS, ICML, ICLR, ACL, EMNLP), contributing to evaluation science as a recognized research area and representing Apple in the research community.

Translate research into production-ready tools by partnering with platform engineers to productionize your methods into evaluation SDKs and APIs used across Apple.

Collaborate with measurement scientists to integrate psychometric methods and validity frameworks into evaluation systems, ensuring evaluators measure what they claim to measure.

Define the team's research agenda for evaluation science by identifying high-leverage open problems, validating that they address real-world challenges faced by ML engineers across Apple, and designing rigorous experimental programs to solve them.

Preferred Qualifications

Publications specifically on evaluation methodology-papers about how to evaluate, not just papers that use evaluation to demonstrate model improvements

Strong hands-on experience with modern ML frameworks (PyTorch, JAX, or TensorFlow) and training or fine-tuning large language models

Experience with theoretical foundations of evaluation: measurement theory and validity frameworks, statistical learning theory (calibration, reliability, decision theory), or preference elicitation and aggregation

Specific research experience in one or more of: reward modeling and RLHF for alignment; LLM-as-judge approaches (calibration, rubric design, bias mitigation); benchmark design and validation (IRT, contamination detection); human evaluation methodology (protocol design, quality control); or agentic and multi-agent system evaluation

Demonstrated passion for evaluation as a research area: conference presentations, workshops, or tutorials on evaluation topics; open-source contributions to evaluation tools or benchmarks; active engagement with the evaluation research community

Experience with cross-disciplinary research, such as collaboration with social scientists, psychometricians, or domain experts

Minimum Qualifications

Ph.D. in Computer Science, Machine Learning, or a closely related field, with a research focus in evaluation-adjacent areas (preference learning, RLHF, human feedback, calibration, automated assessment)

Strong publication record at top-tier conferences (NeurIPS, ICML, ICLR, ACL, EMNLP), including first-author publications demonstrating independent research contributions

Deep technical expertise in at least one evaluation-adjacent ML area, with strong mathematical foundations: preference learning and reward modeling (RLHF, DPO, reward hacking, specification gaming); OR calibration theory, proper scoring rules, and statistical reliability; OR human-AI interaction methodology (active learning, annotation quality, preference elicitation)

Demonstrated ability to implement complex methods from recent papers and run large-scale experiments

Track record of translating research into practical systems-prototypes, tools, or methods adopted by others

Excellent written and verbal communication skills, including the ability to write clear research papers and explain complex concepts to diverse audiences

Pay & Benefits

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $205,400 and $308,500, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

About Apple

Working at Apple means doing more than you ever thought possible and having more impact than you ever imagined.

Size: 10,000+ employees
Industry: Technology: Manufacturing

View company profile