211 jobs for "Machine Learning Evaluation Engineer"

Machine Learning Engineer - Generative AI & Agents

At Apple

Posted on Oct 19

View job Apply on company site

Staff Machine Learning Engineer, Siri Runtime Systems and Interaction

At Apple

Posted on Oct 19

View job Apply on company site

Staff Machine Learning Engineer, Siri Runtime Systems and Interaction

At Apple - Zürich

Posted on Oct 19

View job Apply on company site

Data Scientist SME

At Leidos - Chantilly

Posted on Oct 16

View job Apply on company site

Applied Researcher 4 (AI Safety & Multimodal)

At Capital One - New York · McLean

Posted on Nov 6

View job Apply on company site

Data Scientist SME

At Leidos - Gaithersburg

Posted on Oct 16

View job Apply on company site

Applied Researcher 5 (AI Foundations)

At Capital One - New York · McLean

Posted on Nov 5

View job Apply on company site

Data Scientist SME

At Leidos - Englewood

Posted on Oct 16

View job Apply on company site

Applied Researcher 4 (AI Foundations, VLM Customization)

At Capital One - San Jose · McLean

Posted on Nov 1

View job Apply on company site

Senior MLOps Engineer

At Fisher Investments - Tampa

Posted on Nov 7

View job Apply on company site

Senior Data Scientist

At Aristocrat

Posted on Nov 6

View job Apply on company site

Senior MLOps Engineer

At Fisher Investments - Camas

Posted on Oct 30

View job Apply on company site

ML Engineer

At Aristocrat

Posted on Nov 3

View job Apply on company site

Senior MLOps Engineer

At Fisher Investments - Plano

Posted on Oct 30

View job Apply on company site

Artificial Intelligence / Machine Learning Engineer - Associate

At iCapital - New York

Posted on Nov 6

View job Apply on company site

Internship - Machine Learning (Foundation Models)

At Apple - Zürich

Posted on Oct 19

View job Apply on company site

Internship - Machine Learning (Foundation Models)

At Apple

Posted on Oct 19

View job Apply on company site

Data Scientist SME

At Leidos - Tucson

Posted on Oct 16

View job Apply on company site

Machine Learning Engineer, Software QA - Creativity Apps

At Apple - Vancouver

Posted on Oct 19

View job Apply on company site

Manager, Data Science - Model Risk Office

At Capital One - McLean

Posted on Nov 1

View job Apply on company site

Apple

Machine Learning Engineer - Generative AI & Agents

ChinaPosted 19 days ago

Apply on company site View full job

Why you should apply for a job to Apple:

Ranked as one of the Best Technology Companies in 2020
3.7/5 in overall job satisfaction
3.1/5 in supportive management
66% say women are treated fairly and equally to men
65% would recommend this company to other women
66% say the CEO supports gender diversity

Ratings are based on anonymous reviews by Fairygodboss members. See all reviews ›

Imagine what you could do here! The people here at Apple don't just create products - they build the kind of wonder that's revolutionized industries. It's the diversity of those people and their ideas that encourages the innovation that runs through everything we do, from amazing technology to industry-leading environmental efforts. At Apple, inclusion is a shared responsibility, and we work together to develop a culture where everyone belongs and is inspired to do their best work.

People here at Apple don't just build products; we craft the kind of wonder that's revolutionized entire industries. It's the diversity of those people and their ideas that inspire the innovation that runs through everything we do, from extraordinary technology to industry-leading environmental efforts. Join Apple, and help us leave the world better than we found it.

Apple's Channel Sales team in Greater China is responsible for the development and implementation of all indirect sales efforts for Apple's full product offerings in China, HK, and Taiwan. To continue growing our GC business, we're looking experienced engineers / data scientists with a passion for using machine learning to transform people's life by innovating on intelligent user experiences to join our Analytics & Optimizations on the Sales Analytics Team in China.

In this position, you won't just implement solutions-you'll shape strategies, drive innovation, and elevate industry standards. Your work will empower businesses, optimize performance, and unlock new possibilities for growth.

If you're ready to challenge yourself, expand your expertise, and contribute to a high-impact team, we'd love to hear from you!

Description
Architect AI Agents - Design, orchestrate, and deploy robust AI agent architectures, including multi-agent systems, reasoning frameworks, and dynamic tool-use capabilities (RAG, APIs) to automate complex business workflows and analytics.
Develop Agent Harnesses & Evaluation Pipelines - Build and maintain robust testing harnesses (Agent Harness), simulation environments, and CI/CD pipelines to rigorously evaluate agent performance, safety, reasoning logic, and tool-calling accuracy before production deployment.
Collaborate & Innovate - Work closely with cross-functional teams to identify opportunities, gather requirements, and transform business challenges into scalable, agentic AI solutions.
Build Robust Systems - Partner with data engineers and platform architects to implement high-performance, real-time GenAI applications. Ensure robust state management, secure memory handling, safety guardrails, and low-latency decisioning.
Explore & Evolve - Stay at the forefront of LLM advancements and agentic frameworks (e.g., LangChain, LlamaIndex, AutoGen, Semantic Kernel). Continuously research and implement new paradigms in AI reasoning, planning, and evaluation to refine the team's capabilities.
Communicate Insights - Present complex agent architectures and GenAI strategies to business stakeholders and executives, ensuring technical innovations translate into meaningful business outcomes.

Preferred Qualifications
Advanced Agentic Patterns: Familiarity with advanced reasoning and planning paradigms (e.g., ReAct, Chain-of-Thought, Tree-of-Thoughts) and experience in building evaluation frameworks/sandboxes for generative systems.
Insight: Ability to extract meaningful business insights from complex data interactions and identify the stories behind the patterns.
Creativity: A drive to engineer novel features, design innovative agent tools, and push beyond current off-the-shelf LLM approaches.
Bilingual: Excellent verbal and written communication skills, in both Mandarin Chinese and English.

Minimum Qualifications
AI & Agent Architecture: Deep understanding of Large Language Models (LLMs), prompt engineering, and hands-on experience building autonomous agents or multi-agent orchestration frameworks.
LLMOps & Agent Harness: Practical experience building agent evaluation harnesses, automated testing frameworks, and monitoring pipelines to track hallucination rates, safety metrics, and overall LLM reliability.
System Design: Proven experience in designing scalable software systems, integrating LLMs with external environments (APIs, databases, enterprise tools), and managing complex conversational state/memory.
Machine Learning: Understanding of common machine/deep learning algorithms and practical experience in one or more of the following areas: time series forecasting, anomaly detection, convex optimization, computer vision, NLP, LLM, recommendation system, and Auto ML.
Programming Language: Strong ability to implement AI pipelines and scalable applications in Python (essential), along with familiarity in Scala, Java, or C++.
Communication & Presentation: Superior verbal and written communication skills, with the ability to convey meticulous architectural concepts and AI considerations to non-experts.
Databases: Solid understanding of relational databases (SQL), vector databases for RAG applications, and large-scale distributed systems.
PhD in Computer Science, Artificial Intelligence, Machine Learning, or related field; or PhD in Math, Engineering, Economics, or hard science with AI/data science fellowship; or M.S. in a related field with strong industry experience applying LLMs and AI agent architectures to real business problems.

About Apple

Working at Apple means doing more than you ever thought possible and having more impact than you ever imagined.

Size: 10,000+ employees
Industry: Technology: Manufacturing

View company profile