211 jobs for "Machine Learning Evaluation Engineer"

Responsibilities

About the team
The Platform Responsibility team is responsible for building, optimizing, and maintaining machine learning models and operational processes that support TikTok's Trust & Safety systems. We ensure that automated safety models perform effectively in identifying harmful content, mitigating risks, and maintaining a safe user environment across regions.

The Platform Responsibility team is bringing disruptive innovation to content safety through the deep application of AI. We are building next-generation infrastructure that leverages advanced LLMs to reshape risk detection and governance. By engineering high-quality data pipelines and integrating AI into core decision-making, we drive exponential efficiency gains and precision. Working at the intersection of scalable engineering and technology, we empower global business growth while serving as the foundation of user trust.

To eliminate any doubt, this role involves reading, viewing, listening and examining user-generated content to ensure they comply with community guidelines. Content includes images, video, text related to every day life, but they can also include (but are not limited to) bullying; hate speech; child abuse; sexual assault; torture; bestiality; self-harm; suicide; murder. It is possible that this role will be exposed to harmful content on a daily basis.

Responsibilities
• Perform daily operational tasks such as quality inspection, guidelines and process optimization, queue assignment, and handling escalations for the evaluation project.
• Work closely with stakeholders to stay updated on guideline developments and provide feedback on implementation and execution.
• Conduct daily audits on an internal system and provide error analysis and feedback to stakeholders (R&D & Product Manager).
• Monitor the quality scores of evaluators and conduct root cause analysis with the management team.
• Monitor project data, record daily output and quality scores, prepare data analysis/reports for projects, and validate reports and data provided to stakeholders/partners.
• Localize the guidelines and design training schedules and coordinate and liaise with key stakeholders to ensure the successful go-live within the targeted timeframe.
• Deliver process/product/guideline training to new joiners.
• Play a role in setting up product knowledge tests, sharing result analysis, and working with key stakeholders to improve the product knowledge of the team.
• Able to work with sensitive content including but not limited to child exploitation, diverse religious and political perspectives, violence, and adult/sexual content. (Not frequent)
• Perform any other duties as reasonably required to support the role.

Qualifications

Minimum Qualifications
• Bachelor's Degree or equivalent education/experience.
• Fluency in Arabic is required as the role requires communication with Arabic markets, fluent in English is also required as it is the working language.
• Work experience in search engines and social media platforms; Former experience in Search relevant business.
• Experience in cross functional work and stakeholder management.
• Experience in analysis and communication skills with a good sense of flexibility.

Preferred Qualifications
• Experience in project management, project operation, or familiarity with users' Internet usage habits.

Important Note: Please be advised that the job posting is on behalf of a third-party agency. This is a 12-month temporary assignment managed by a third-party agency who will be your employer. While you may assigned to work at TikTok, you will not be a TikTok employee. All contractual terms, including payroll and benefits, will be handled by a third-party agency. By applying, you agree that the information provided in your application may be processed and retained by TikTok for recruitment purposes and shared with a third-party agency in accordance with TikTok's Applicant Privacy Notice https://lifeattiktok.com/legal/privacy

Responsibilities

Qualifications

Qualifications

Minimum Qualifications
• Bachelor's Degree or equivalent education/experience.
• Fluency in Arabic is required as the role requires communication with Arabic markets, fluent in English is also required as it is the working language.
• Work experience in search engines and social media platforms; Former experience in Search relevant business.
• Experience in cross functional work and stakeholder management.
• Experience in analysis and communication skills with a good sense of flexibility.

Preferred Qualifications
• Experience in project management, project operation, or familiarity with users' Internet usage habits.

Important Note: Please be advised that the job posting is on behalf of a third-party agency. This is a 12-month temporary assignment managed by a third-party agency who will be your employer. While you may assigned to work at TikTok, you will not be a TikTok employee. All contractual terms, including payroll and benefits, will be handled by a third-party agency. By applying, you agree that the information provided in your application may be processed and retained by TikTok for recruitment purposes and shared with a third-party agency in accordance with TikTok's Applicant Privacy Notice https://lifeattiktok.com/legal/privacy

About TikTok

TikTok is the leading destination for short-form mobile video and our mission is to inspire creativity and bring joy.

Size: 10,000+ employees
Industry: Technology: Consumer Internet

View company profile