16 jobs for "AI Project Manager (Model Evaluation) - AI Data Service Operations"

Responsibilities

Our Company will be prioritizing applicants who have a current right to work in Singapore, and do not require Our Company's sponsorship of a visa.

About the Team
The AI Data Service and Operations (ADSO) team is responsible for providing safety and non-safety data annotation services and search operation services for all of the company's international products, which can also help international products build their own data ecological security.

The Safety Model Operations [SMO] team within ADSO is responsible for building, optimizing, and maintaining machine learning models and operational processes that support TikTok's Trust & Safety systems. We ensure that automated safety models perform effectively in identifying harmful content, mitigating risks, and maintaining a safe user environment across regions.

What will I do?
- Work closely with cross-functional teams to help design, improve, and manage the entire model training and evaluation process. Identify model performance gaps and loopholes and propose valid initiatives to improve model performance.
- Explore the latest LLM tools and continuously improve data pipelines to make data production more efficient. Stay updated on new industry trends to help build smarter and more efficient data systems.
- Research new model training methods from both academic and industry sources. Identify weaknesses in current training data and propose new solutions to improve scalability, efficiency, and coverage.
- Take ownership of end-to-end data production, including setting dataset standards, performing model evaluations, and ensuring high-quality data delivery.

Qualifications

Minimum Qualifications
- Bachelor's or Master's degree in Computer Science, Data Science, Engineering, or a related quantitative field
- A solid understanding of machine learning concepts, including large language models (LLMs) and transformer architectures.
- Hands-on experience with data analysis, Python, and ML frameworks such as TensorFlow or PyTorch.
- Possess fundamental project management skills, understand the end-to-end project operation process and key focus areas; ability to work collaboratively in cross-functional teams and communicate effectively with both technical and non-technical stakeholders.
- Excellent learning, problem-solving, and execution skills, with a strong sense of ownership and basic English communication skills.

Preferred Qualifications
- Experience in trust and safety, content moderation, or knowledge of regulatory compliance in content safety.
- Practical experience with model optimization, MLOps tools, and big data technologies (e.g., Spark, Hadoop).
- Hands-on experience with cloud platforms (e.g., AWS, GCP, Azure), container technologies (Docker, Kubernetes), and CI/CD practices.

Responsibilities

Qualifications

Qualifications

Minimum Qualifications
- Bachelor's or Master's degree in Computer Science, Data Science, Engineering, or a related quantitative field
- A solid understanding of machine learning concepts, including large language models (LLMs) and transformer architectures.
- Hands-on experience with data analysis, Python, and ML frameworks such as TensorFlow or PyTorch.
- Possess fundamental project management skills, understand the end-to-end project operation process and key focus areas; ability to work collaboratively in cross-functional teams and communicate effectively with both technical and non-technical stakeholders.
- Excellent learning, problem-solving, and execution skills, with a strong sense of ownership and basic English communication skills.

Preferred Qualifications
- Experience in trust and safety, content moderation, or knowledge of regulatory compliance in content safety.
- Practical experience with model optimization, MLOps tools, and big data technologies (e.g., Spark, Hadoop).
- Hands-on experience with cloud platforms (e.g., AWS, GCP, Azure), container technologies (Docker, Kubernetes), and CI/CD practices.

About TikTok

TikTok is the leading destination for short-form mobile video and our mission is to inspire creativity and bring joy.

Size: 10,000+ employees
Industry: Technology: Consumer Internet

View company profile