LLM Evaluation Product Operations Specialist - TikTok
Jun 23, 2026 Singapore
About us
TikTok is the leading destination for short-form mobile video and our mission is to inspire creativity and bring joy.
- Size: 10,000+ employees
- Industry: Technology: Consumer Internet
Why you should apply for a job to TikTok:
4.5/5 in overall job satisfaction
4.5/5 in supportive management
100% say women are treated fairly and equally to men
100% would recommend this company to other women
100% say the CEO supports gender diversity
Ratings are based on anonymous reviews by Fairygodboss members. See all reviews ›
Responsibilities
About the Team:
We are looking for a sharp and organized Product Operations specialist to join TikTok's Tako team. You will play a key role in building and operationalizing the evaluation framework for Tako's in-app AI chatbot experience, bridging user insights, data analysis, and cross-functional execution to drive continuous product improvement.
Responsibilities
- Own the end-to-end design and implementation of the AI chatbot experience evaluation framework within Tako; support ongoing product iteration and optimization.
- Leverage user research and data analysis to uncover user needs; define the ideal experience quality standard for the product and drive improvements in model capability and user satisfaction.
- Collaborate with strategy and algorithm teams to build a scenario-based evaluation metrics system for Tako; deliver analytical insights and recommendations to improve and retain search users.
- Partner with international delivery teams to drive the execution of evaluation programs; leverage automated evaluation methods to ensure projects are delivered on time and to quality standards.
Qualifications
Minimum Qualification(s):
- Bachelor's degree or above.
- Strong written communication skills and the ability to think abstractly; capable of clearly defining diverse user scenarios and articulating experience quality standards.
- Highly detail-oriented and well-organized; strong logical thinking with a solid data mindset.
- Excellent communicator and collaborative team player.
Preferred Qualification(s):
- Prior experience in LLM evaluation or user-facing product roles.
About the Team:
We are looking for a sharp and organized Product Operations specialist to join TikTok's Tako team. You will play a key role in building and operationalizing the evaluation framework for Tako's in-app AI chatbot experience, bridging user insights, data analysis, and cross-functional execution to drive continuous product improvement.
Responsibilities
- Own the end-to-end design and implementation of the AI chatbot experience evaluation framework within Tako; support ongoing product iteration and optimization.
- Leverage user research and data analysis to uncover user needs; define the ideal experience quality standard for the product and drive improvements in model capability and user satisfaction.
- Collaborate with strategy and algorithm teams to build a scenario-based evaluation metrics system for Tako; deliver analytical insights and recommendations to improve and retain search users.
- Partner with international delivery teams to drive the execution of evaluation programs; leverage automated evaluation methods to ensure projects are delivered on time and to quality standards.
Minimum Qualification(s):
- Bachelor's degree or above.
- Strong written communication skills and the ability to think abstractly; capable of clearly defining diverse user scenarios and articulating experience quality standards.
- Highly detail-oriented and well-organized; strong logical thinking with a solid data mindset.
- Excellent communicator and collaborative team player.
Preferred Qualification(s):
- Prior experience in LLM evaluation or user-facing product roles.
About the Team:
We are looking for a sharp and organized Product Operations specialist to join TikTok's Tako team. You will play a key role in building and operationalizing the evaluation framework for Tako's in-app AI chatbot experience, bridging user insights, data analysis, and cross-functional execution to drive continuous product improvement.
Responsibilities
- Own the end-to-end design and implementation of the AI chatbot experience evaluation framework within Tako; support ongoing product iteration and optimization.
- Leverage user research and data analysis to uncover user needs; define the ideal experience quality standard for the product and drive improvements in model capability and user satisfaction.
- Collaborate with strategy and algorithm teams to build a scenario-based evaluation metrics system for Tako; deliver analytical insights and recommendations to improve and retain search users.
- Partner with international delivery teams to drive the execution of evaluation programs; leverage automated evaluation methods to ensure projects are delivered on time and to quality standards.
Qualifications
Minimum Qualification(s):
- Bachelor's degree or above.
- Strong written communication skills and the ability to think abstractly; capable of clearly defining diverse user scenarios and articulating experience quality standards.
- Highly detail-oriented and well-organized; strong logical thinking with a solid data mindset.
- Excellent communicator and collaborative team player.
Preferred Qualification(s):
- Prior experience in LLM evaluation or user-facing product roles.
Responsibilities
ResponsibilitiesAbout the Team:
We are looking for a sharp and organized Product Operations specialist to join TikTok's Tako team. You will play a key role in building and operationalizing the evaluation framework for Tako's in-app AI chatbot experience, bridging user insights, data analysis, and cross-functional execution to drive continuous product improvement.
Responsibilities
- Own the end-to-end design and implementation of the AI chatbot experience evaluation framework within Tako; support ongoing product iteration and optimization.
- Leverage user research and data analysis to uncover user needs; define the ideal experience quality standard for the product and drive improvements in model capability and user satisfaction.
- Collaborate with strategy and algorithm teams to build a scenario-based evaluation metrics system for Tako; deliver analytical insights and recommendations to improve and retain search users.
- Partner with international delivery teams to drive the execution of evaluation programs; leverage automated evaluation methods to ensure projects are delivered on time and to quality standards.
Qualifications
QualificationsMinimum Qualification(s):
- Bachelor's degree or above.
- Strong written communication skills and the ability to think abstractly; capable of clearly defining diverse user scenarios and articulating experience quality standards.
- Highly detail-oriented and well-organized; strong logical thinking with a solid data mindset.
- Excellent communicator and collaborative team player.
Preferred Qualification(s):
- Prior experience in LLM evaluation or user-facing product roles.
Additional Information
- Job category: Operations
- Posted: Jun 23, 2026