8 jobs for "Machine Learning Evaluation Engineer"

AI Model and Agent Operation Project Intern (Business Integrity) - 2027 Start

At TikTok

Posted on Sep 17

View job Apply on company site

AI Model and Agent Operation Project Intern (Business Integrity) - 2026 Start

At TikTok

Posted on Aug 3

View job Apply on company site

Operations Specialist (Red Team Evaluation) - TikTok Safety Products

At TikTok

Posted on Jun 3

View job Apply on company site

Senior Manager, Data Science and Machine Learning

At Squarespace - New York City

Posted on Oct 14

View job Apply on company site

Safety Model Data Quality Assurance Analyst - Arabic Speaking (Third-Party Associate)

At TikTok - Bucharest

Posted on Oct 27

View job Apply on company site

AI Reinforcement Training Intern (TikTok Platform Responsibility) - 2027 Start

At TikTok - Dublin

Posted on Oct 26

View job Apply on company site

Product Operations Project Intern (TikTok-Platform Responsibility-Teen Experiences) - 2026 Start

At TikTok - San Jose

Posted on Aug 25

View job Apply on company site

AI Project Manager (Data Strategy) - AI Data Service and Operation (Safety Model Operations)

At TikTok

Posted on Oct 28

View job Apply on company site

TikTok

AI Model and Agent Operation Project Intern (Business Integrity) - 2027 Start

SingaporeOperationsPosted Sep 17, 2026

Apply on company site View full job

Why you should apply for a job to TikTok:

4.5/5 in overall job satisfaction
4.5/5 in supportive management
100% say women are treated fairly and equally to men
100% would recommend this company to other women
100% say the CEO supports gender diversity

Ratings are based on anonymous reviews by Fairygodboss members. See all reviews ›

Responsibilities

Team Introduction
Our team is building an intelligent and automated AI Model Operations framework to continuously improve the quality, efficiency, and scalability of Auto Moderation systems. By combining policy operationalization, Data driven insights, model strategy optimization, and AI-powered automation, we enable machine learning models to deliver accurate and consistent moderation decisions at scale.

You will work closely with Policy, Product, Engineering, Data Science, and Machine Learning teams to support the end-to-end life cycle of AI model operations, from policy implementation and performance analysis to strategy optimization and operational automation.

As a Project Intern, you will contribute to impactful short-term projects and gain hands-on experience in a fast-paced, professional environment. This internship offers the opportunity to develop practical skills, apply your knowledge to real-world challenges, and explore your career interests.
Applications are reviewed on a rolling basis, so we encourage you to apply early.

Responsibilities
- Translate moderation policies and business requirements into structured, machine-executable rules and
operational strategies.
- Monitor and analyze key model performance metrics (e.g., Accuracy, Recall, Precision, False Positive Rate)
to identify optimization opportunities.
- Conduct root cause analysis on false positives, false negatives and edge cases, and propose
strategy-driven improvements.
- Conduct root cause analysis on false positives, false negatives and edge cases, and propose data- and strategy-driven improvements.
- Support model evaluation, Golden Set construction, and strategy validation to improve model quality and
consistency.
- Explore AI-powered operational automation by leveraging LLMs, AI Agents, and workflow automation to
improve analysis, issue diagnosis, and strategy optimization.
- Collaborate with cross-functional teams including Policy, Product, Engineering, Machine Learning, and
Operations to drive continuous model improvement.

Qualifications

Minimum Qualifications
- Currently pursuing an Undergraduate's in Computer Science, Mathematics, Information Systems, Artificial Intelligence, Data Science, Statistics or a related AI discipline.
- Strong interest in AI, Machine Learning, Trust & Safety, or AI Model Operations.
- Strong analytical and problem-solving skills with the ability to derive insights from data and translate them into actionable recommendations.
- Familiarity with Excel and SQL; knowledge of Python or basic machine learning concepts is a plus.
- Excellent communication, learning agility, and cross-functional collaboration skills.
- Available to intern at least 4 days per week for a minimum of 3 months.

Preferred Qualifications
- Experience in data analysis, strategy operations, Trust & Safety, AI products, or content moderation projects.
- Familiarity with SQL, Python, or data visualization tools.
- Hands-on experience with LLMs, Prompt Engineering, AI Agents, model evaluation, or workflow automation is a plus.

Responsibilities

Qualifications

Qualifications

Minimum Qualifications
- Currently pursuing an Undergraduate's in Computer Science, Mathematics, Information Systems, Artificial Intelligence, Data Science, Statistics or a related AI discipline.
- Strong interest in AI, Machine Learning, Trust & Safety, or AI Model Operations.
- Strong analytical and problem-solving skills with the ability to derive insights from data and translate them into actionable recommendations.
- Familiarity with Excel and SQL; knowledge of Python or basic machine learning concepts is a plus.
- Excellent communication, learning agility, and cross-functional collaboration skills.
- Available to intern at least 4 days per week for a minimum of 3 months.

Preferred Qualifications
- Experience in data analysis, strategy operations, Trust & Safety, AI products, or content moderation projects.
- Familiarity with SQL, Python, or data visualization tools.
- Hands-on experience with LLMs, Prompt Engineering, AI Agents, model evaluation, or workflow automation is a plus.

About TikTok

TikTok is the leading destination for short-form mobile video and our mission is to inspire creativity and bring joy.

Size: 10,000+ employees
Industry: Technology: Consumer Internet

View company profile