352 jobs for "Software Engineer - Evaluation Engineering"

AIML - Sr Lead Engineer, Evaluation

At Apple - Seattle

Posted on Oct 17

View job Apply on company site

Software Engineer - Generative UI, Input Experience

At Apple - Cupertino

Posted on Oct 17

View job Apply on company site

AIML Sr. Privacy & Data Governance Engineer, Evaluation

At Apple - Cupertino

Posted on Oct 17

View job Apply on company site

AIML - Sr Instrumentation Platform Engineer, Evaluation

At Apple - Sunnyvale

Posted on Oct 10

View job Apply on company site

Infrastructure Engineer Lead - NonStop Software Engineer

At Merrill - Plano · Richmond

Posted on Nov 5

View job Apply on company site

Software Engineer - Stack (AWS, Java, JavaScript, TypeScript)

At Capital One - McLean

Posted on Nov 4

View job Apply on company site

IND Senior Software Engineer

At The Hartford - Hyderabad

Posted on Nov 7

View job Apply on company site

TPS Systems Test Engineer

At Leidos - Washington

Posted on Nov 3

View job Apply on company site

Research Engineer, Agentic Video Editing - TikTok

At TikTok - San Jose

Posted on Nov 6

View job Apply on company site

C++/Python Software Engineer

At Cadence Design Systems - Shanghai

Posted on Nov 2

View job Apply on company site

Software Engineer I, Full Stack, Promotions

At Chewy - Boston

Posted on Nov 6

View job Apply on company site

Software Development Engineer Intermediate

At Equinix - Remote / Flexible

Posted on Nov 6

View job Apply on company site

Machine Learning Engineer Intern (E-Commerce Supply Chain & Logistics-LLM / Agent )- 2027 Summer

At TikTok - Seattle

Posted on Oct 16

View job Apply on company site

INDStaff Software Engineer - AI

At The Hartford - Hyderabad

Posted on Nov 6

View job Apply on company site

AI Engineer 5 (Gen AI SDK: Agentic AI, Guardrails, Evaluation)

At Capital One - New York · San Francisco

Posted on Oct 19

View job Apply on company site

Senior Mechanical Engineer

At Leidos - Lynnwood

Posted on Oct 24

View job Apply on company site

Software Engineer II (Meshing)

At Cadence Design Systems - Remote / Flexible

Posted on Oct 16

View job Apply on company site

MDS Systems Test Engineer

At Leidos - Washington

Posted on Oct 21

View job Apply on company site

Engineer 4 ( Cloud Operations Resilience Engineering) (MEG)

At Capital One - McLean · Richmond

Posted on Oct 16

View job Apply on company site

AI Engineer

At Fisher Investments - Tampa

Posted on Nov 7

View job Apply on company site

TikTok

Research Engineer, Agentic Video Editing - TikTok

San Jose$162,000 – $387,600Posted 2 days ago

Apply on company site View full job

Why you should apply for a job to TikTok:

4.5/5 in overall job satisfaction
4.5/5 in supportive management
100% say women are treated fairly and equally to men
100% would recommend this company to other women
100% say the CEO supports gender diversity

Ratings are based on anonymous reviews by Fairygodboss members. See all reviews ›

Responsibilities

We are building the next generation of AI-native creation tools powered by intelligent AI agents. Our mission is to transform how people create by embedding agentic AI directly into creative workflows-from AI-powered camera effect generation to AI-driven video editing and storytelling.

Our team operates at the intersection of AI research, systems engineering, and creative product development, translating advances in agentic AI into scalable, real-world creation tools used by millions of creators. We work closely with product and design partners to ensure that sophisticated AI systems result in simple, powerful, and intuitive creative experiences.

Responsibilities
- Build end-to-end agentic video editing systems, working across the agent harness, backend services, and evaluation pipelines. Own scoped features and improvements from prototyping through production.
- Develop and improve the agent harness, including planning, tool use, context management, and error recovery for multimodal editing workflows.
- Build reliable backend services for agent execution, session management, and media processing, and improve system latency, cost, and reliability.
- Develop evaluation and feedback loops, including LLM judges, benchmarks, and human review workflows, to measure editing quality, diagnose failures, and catch regressions.
- Propose new ideas and adapt advances from research and industry into practical experiments, using evaluation results and user feedback to continuously improve agent capabilities and video quality.
- Collaborate with research, engineering, and product partners to turn successful experiments into useful editing experiences for creators.

Qualifications

Minimum Qualifications
- Bachelor's or Master's degree in Computer Science, AI, or a related field, or equivalent practical experience.
- Strong programming skills in Python and solid software engineering fundamentals.
- Foundational knowledge of machine learning and large language models.
- Hands-on experience building an LLM application, AI Agent, or multimodal AI project through coursework, research, internships, or personal projects.
- Ability to design experiments, analyze failures, and turn findings into working improvements.
- Interest in video creation and building useful tools for creators.

Preferred Qualifications
- Experience with tool-use agents, context management, or debugging and improving multi-step agent workflows.
- Familiarity with video understanding, audio and visual processing.
- Experience with evaluation datasets, human annotation, or model-based evaluation.
- Familiarity with video editing tools or media processing libraries such as FFmpeg.
- Relevant research, open-source contributions, or projects that demonstrate the ability to build and evaluate AI systems.

Job Information

[For Pay Transparency] Compensation Description (annually)

The base salary range for this position in the selected city is $162000 - $387600 annually.

Compensation may vary outside of this range depending on a number of factors, including a candidate's qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.

Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure).

The Company reserves the right to modify or change these benefits programs at any time, with or without notice.

For Los Angeles County (unincorporated) Candidates:

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:

1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;

2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and

3. Exercising sound judgment.

Responsibilities

Qualifications

Qualifications

Minimum Qualifications
- Bachelor's or Master's degree in Computer Science, AI, or a related field, or equivalent practical experience.
- Strong programming skills in Python and solid software engineering fundamentals.
- Foundational knowledge of machine learning and large language models.
- Hands-on experience building an LLM application, AI Agent, or multimodal AI project through coursework, research, internships, or personal projects.
- Ability to design experiments, analyze failures, and turn findings into working improvements.
- Interest in video creation and building useful tools for creators.

Preferred Qualifications
- Experience with tool-use agents, context management, or debugging and improving multi-step agent workflows.
- Familiarity with video understanding, audio and visual processing.
- Experience with evaluation datasets, human annotation, or model-based evaluation.
- Familiarity with video editing tools or media processing libraries such as FFmpeg.
- Relevant research, open-source contributions, or projects that demonstrate the ability to build and evaluate AI systems.

About TikTok

TikTok is the leading destination for short-form mobile video and our mission is to inspire creativity and bring joy.

Size: 10,000+ employees
Industry: Technology: Consumer Internet

View company profile