24 jobs for "Machine Learning Evaluation Engineer"

Applied Researcher 5 (AI Foundations: Evaluation and Agentic Workflows)

At Capital One - McLean · Cambridge

Posted on Nov 8

View job Apply on company site

Research Engineer, Agentic Video Editing - TikTok

At TikTok - San Jose

Posted on Nov 6

View job Apply on company site

Applied Researcher 5

At Capital One - San Jose · San Francisco

Posted on Nov 6

View job Apply on company site

Applied Researcher 4

At Capital One - San Jose · San Francisco

Posted on Nov 6

View job Apply on company site

Senior MLOps Engineer

At Fisher Investments - Tampa

Posted on Nov 7

View job Apply on company site

Senior Data Scientist

At Aristocrat

Posted on Nov 6

View job Apply on company site

ML Engineer

At Aristocrat

Posted on Nov 3

View job Apply on company site

Artificial Intelligence / Machine Learning Engineer - Associate

At iCapital - New York

Posted on Nov 6

View job Apply on company site

Applied Researcher 4 (AI Safety & Multimodal)

At Capital One - New York · McLean

Posted on Nov 6

View job Apply on company site

Applied Researcher 5 (AI Foundations)

At Capital One - New York · McLean

Posted on Nov 5

View job Apply on company site

IND Lead Engineer, Data

At The Hartford - Hyderabad

Posted on Nov 6

View job Apply on company site

C++/Python Software Engineer

At Cadence Design Systems - Shanghai

Posted on Nov 2

View job Apply on company site

Sr Data Scientist

At Northwestern Mutual – Corporate Careers - Milwaukee

Posted on Nov 7

View job Apply on company site

Research Scientist/Software Engineer, Neural Graphics and World Models - Global Frontier Tech Recruitment Program - 2027 Start (PhD)

At TikTok - San Jose

Posted on Nov 2

View job Apply on company site

Neural Graphics and World Models Research Scientist/Software Engineer Graduate (TikTok, Engine&Tools) - 2027 Start (PhD)

At TikTok - San Jose

Posted on Nov 2

View job Apply on company site

Senior ML Engineer

At Aristocrat

Posted on Nov 3

View job Apply on company site

Principal Associate, Data Scientist - SBB Marketing & Deposit Strategy

At Capital One - McLean

Posted on Nov 7

View job Apply on company site

Principal Associate, Data Scientist -Financial Services-Consumer Risk Modeling

At Capital One - Plano

Posted on Nov 7

View job Apply on company site

Manager, Data Scientist - Business Cards & Payments

At Capital One - New York · McLean

Posted on Nov 7

View job Apply on company site

Manager, Data Scientist - SBB Marketing & Deposit Strategy

At Capital One - McLean

Posted on Nov 6

View job Apply on company site

TikTok

Research Engineer, Agentic Video Editing - TikTok

San Jose$162,000 – $387,600Posted 2 days ago

Apply on company site View full job

Why you should apply for a job to TikTok:

4.5/5 in overall job satisfaction
4.5/5 in supportive management
100% say women are treated fairly and equally to men
100% would recommend this company to other women
100% say the CEO supports gender diversity

Ratings are based on anonymous reviews by Fairygodboss members. See all reviews ›

Responsibilities

We are building the next generation of AI-native creation tools powered by intelligent AI agents. Our mission is to transform how people create by embedding agentic AI directly into creative workflows-from AI-powered camera effect generation to AI-driven video editing and storytelling.

Our team operates at the intersection of AI research, systems engineering, and creative product development, translating advances in agentic AI into scalable, real-world creation tools used by millions of creators. We work closely with product and design partners to ensure that sophisticated AI systems result in simple, powerful, and intuitive creative experiences.

Responsibilities
- Build end-to-end agentic video editing systems, working across the agent harness, backend services, and evaluation pipelines. Own scoped features and improvements from prototyping through production.
- Develop and improve the agent harness, including planning, tool use, context management, and error recovery for multimodal editing workflows.
- Build reliable backend services for agent execution, session management, and media processing, and improve system latency, cost, and reliability.
- Develop evaluation and feedback loops, including LLM judges, benchmarks, and human review workflows, to measure editing quality, diagnose failures, and catch regressions.
- Propose new ideas and adapt advances from research and industry into practical experiments, using evaluation results and user feedback to continuously improve agent capabilities and video quality.
- Collaborate with research, engineering, and product partners to turn successful experiments into useful editing experiences for creators.

Qualifications

Minimum Qualifications
- Bachelor's or Master's degree in Computer Science, AI, or a related field, or equivalent practical experience.
- Strong programming skills in Python and solid software engineering fundamentals.
- Foundational knowledge of machine learning and large language models.
- Hands-on experience building an LLM application, AI Agent, or multimodal AI project through coursework, research, internships, or personal projects.
- Ability to design experiments, analyze failures, and turn findings into working improvements.
- Interest in video creation and building useful tools for creators.

Preferred Qualifications
- Experience with tool-use agents, context management, or debugging and improving multi-step agent workflows.
- Familiarity with video understanding, audio and visual processing.
- Experience with evaluation datasets, human annotation, or model-based evaluation.
- Familiarity with video editing tools or media processing libraries such as FFmpeg.
- Relevant research, open-source contributions, or projects that demonstrate the ability to build and evaluate AI systems.

Job Information

[For Pay Transparency] Compensation Description (annually)

The base salary range for this position in the selected city is $162000 - $387600 annually.

Compensation may vary outside of this range depending on a number of factors, including a candidate's qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.

Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure).

The Company reserves the right to modify or change these benefits programs at any time, with or without notice.

For Los Angeles County (unincorporated) Candidates:

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:

1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;

2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and

3. Exercising sound judgment.

Responsibilities

Qualifications

Qualifications

Minimum Qualifications
- Bachelor's or Master's degree in Computer Science, AI, or a related field, or equivalent practical experience.
- Strong programming skills in Python and solid software engineering fundamentals.
- Foundational knowledge of machine learning and large language models.
- Hands-on experience building an LLM application, AI Agent, or multimodal AI project through coursework, research, internships, or personal projects.
- Ability to design experiments, analyze failures, and turn findings into working improvements.
- Interest in video creation and building useful tools for creators.

Preferred Qualifications
- Experience with tool-use agents, context management, or debugging and improving multi-step agent workflows.
- Familiarity with video understanding, audio and visual processing.
- Experience with evaluation datasets, human annotation, or model-based evaluation.
- Familiarity with video editing tools or media processing libraries such as FFmpeg.
- Relevant research, open-source contributions, or projects that demonstrate the ability to build and evaluate AI systems.

About TikTok

TikTok is the leading destination for short-form mobile video and our mission is to inspire creativity and bring joy.

Size: 10,000+ employees
Industry: Technology: Consumer Internet

View company profile