338 jobs for "Machine Learning Evaluation Engineer"

Applied AI/ML Software Engineer

At Apple - San Diego

Posted on Oct 28

View job Apply on company site

Senior Privacy Software Engineer, Privacy Engineering (sensing and Intelligence)

At Apple - Cupertino

Posted on Oct 19

View job Apply on company site

Software Development Engineer in Test - Video Codec

At Apple - Cupertino

Posted on Oct 17

View job Apply on company site

Test & Validation Engineer

At Leidos - Rockville

Posted on Oct 1

View job Apply on company site

AI Engineer 4 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation)

At Capital One - New York · San Francisco

Posted on Oct 8

View job Apply on company site

Senior Research Scientist/Software Engineer, TikTok-Neural Graphics and World Models

At TikTok - San Jose

Posted on Aug 3

View job Apply on company site

Test & Validation Engineer

At Leidos - Reston

Posted on Oct 1

View job Apply on company site

AI Engineer 5 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation)

At Capital One - New York · San Francisco

Posted on Oct 8

View job Apply on company site

Summer Associate Internship (Payments AI Engineer)

At Navy Federal Credit Union - Pensacola

Posted on Sep 10

View job Apply on company site

AI Engineer 5 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation)

At Capital One - San Francisco · McLean

Posted on Oct 8

View job Apply on company site

Agentic AI Engineer - Assistant Vice President / Vice President

At iCapital

Posted on May 27

View job Apply on company site

IND Lead Engineer, Data

At The Hartford - Hyderabad

Posted on Oct 22

View job Apply on company site

Senior Privacy Engineer, Intelligence (User Privacy)

At Apple - Cupertino

Posted on Oct 16

View job Apply on company site

Sr Full-Stack Software Engineer, AIML Data Operations

At Apple - Cupertino

Posted on Oct 16

View job Apply on company site

AI Software Engineer, Apple Cloud AI Platform

At Apple - Seattle

Posted on Oct 16

View job Apply on company site

ML Data Operations Engineer

At Apple - Cupertino

Posted on Oct 10

View job Apply on company site

Senior Search Engineer - Services Special Projects

At Apple - Cupertino

Posted on Oct 10

View job Apply on company site

AI Engineer 4 (Gen AI Platform Services: Agentic AI, Agent Guardrails, Agent Evaluation, Agent Memory)

At Capital One - San Francisco · McLean

Posted on Oct 8

View job Apply on company site

AI Engineer 4 (AI Foundations: Benchmarking, Evaluation, and Explainability)

At Capital One - McLean · Cambridge

Posted on Oct 3

View job Apply on company site

Sr. Manager, AI Engineer (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation)

At Capital One - New York · San Francisco

Posted on Oct 10

View job Apply on company site

Apple

Software Development Engineer in Test - Video Codec

Cupertino, CA$184,700 – $324,800Posted 22 days ago

Apply on company site View full job

Why you should apply for a job to Apple:

Ranked as one of the Best Technology Companies in 2020
3.7/5 in overall job satisfaction
3.1/5 in supportive management
66% say women are treated fairly and equally to men
65% would recommend this company to other women
66% say the CEO supports gender diversity

Ratings are based on anonymous reviews by Fairygodboss members. See all reviews ›

Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build, service we create, or Apple Store experience we deliver is the result of us making each other's ideas stronger. Here, you'll do more than join something - you'll add something. Video Engineering is seeking a strong, experienced, self-motivated Software Development Engineer in Test with a passion for making all Apple product experience the best it can be. You will be working on the latest Apple products, ensuring that the video experience is the best in the world!

Description

In this role, your main responsibility will be test design and development for video processing frameworks and low-level software of video codecs, covering both functionality verification and quality measurement across all iOS/macOS/tvOS/visionOS platforms. The work targets image & video encoding/decoding, editing/post-processing, and machine learning based technologies.

Your daily tasks will include developing software and tools to validate algorithms and code changes of projects, designing test cases, and architecting test harnesses. You will implement tests in C/C++, Objective-C, Swift, and Python/Shell scripting using test frameworks. Additionally, you will automate workflows in testing and quality evaluation pipelines, triage and root-cause failures, and drive early test strategy and planning. You will also build LLM-based tools and agentic workflows that extend what these pipelines can automate at scale.

You will partner with R&D engineering teams and both internal and external cross-functional partners to ensure image and video frameworks/firmware/drivers deliver the highest quality video experience.

Preferred Qualifications

Strong knowledge of software engineering and development lifecycles

Experience in building LLM-powered tooling - including prompt engineering, agent design, tool/API integration, and MCP-based integrations

Experience in test development using frameworks such as XCTest or PyTest

Experience with white-box / grey-box testing, API testing, mutation testing, static testing, or code coverage analysis

Experience in image or video quality evaluation or model benchmarking and quality metrics

Understanding of image or video codecs (e.g. AVC, HEVC, VP9, AV1) and video processing pipelines

Excellent problem solving and debugging skills

Great communication and negotiation skills, able to collaborate and work as a team

Self-sufficient and self-motivated, and able to work independently and drive projects to closure in a timely manner

Minimum Qualifications

BS and a minimum of 10 years relevant industry experience

6+ years programming experience in C/C++, Objective-C/Swift, and Python

6+ years development experience on macOS or unix/linux platform

Hands-on experience using LLMs in software development, including building workflows with AI/LLM-based tools

Experience in test case development and software testing methodologies

Understanding of software engineering concepts with hands-on experience practicing CI/CD in software development

Pay & Benefits

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $184,700 and $324,800, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

About Apple

Working at Apple means doing more than you ever thought possible and having more impact than you ever imagined.

Size: 10,000+ employees
Industry: Technology: Manufacturing

View company profile