Search Operation Specialist for AI Model Evaluation

TikTok

4.5

(6)

South Korea

Why you should apply for a job to TikTok:

  • 4.5/5 in overall job satisfaction
  • 4.5/5 in supportive management
  • 100% say women are treated fairly and equally to men
  • 100% would recommend this company to other women
  • 100% say the CEO supports gender diversity
  • Ratings are based on anonymous reviews by Fairygodboss members.
  • Employee well-being is supported via hybrid work, short-term counseling through our EAP and a premium subscription to Headspace.
  • We embrace diversity across all dimensions and provide employees with 9 employee resource groups globally, including our WOMEN ERG.
  • Comprehensive parental leave policy as well as fertility treatment through healthcare providers with a $20,000 lifetime maximum.
  • #7329362230352857382

    Position summary

    us.

    About Trust & Safety
    Building a world where people can safely discover, create and connect. The Trust & Safety (T&S) team at TikTok helps ensure that our global online community is safe and empowered to create and enjoy content across all of our applications. We have invested heavily in human and machine-based moderation to remove harmful content quickly and often before it reaches our general community.

    About the Team
    The Search Operations team aims to improve search user experience, contribute significant DAU impact to the products and drive for increase in traffic and GMV.

    The T&S evaluation and investigation team, working closely with the search team, taking the evaluation standards as the baseline and principles, and manually evaluating the search query and the corresponding search results page to reflect the real user experience of the search function.

    The team is committed to providing search and evaluation services for international products, with resource support provided by different countries around the world, and global members conduct evaluations according to unified guidelines. The evaluation scope covers multiple search sections, such as basic search experience, recommended search, search advertising, and search security. As a bridge for business communication domestically and abroad, the team is responsible for key nodes such as standard writing, training Q&A, report output, and human efficiency management to effectively promote the execution and implementation of projects.

    It is possible that this role will be exposed to harmful content as part of the core role/as part of project/ in response to escalation requests/by chance.

    This may occur in the form of images, video, and text related to every-day life, but it can also include (but is not limited to) bullying; hate speech; child safety; depictions of harm to self and others, and harm to animals.

    What will I be doing?

    • Complete regular assessments related to AI model quality based on business requirements in accordance with evaluation standard documents. Major in journalism, literature, mathematics, computer science, medicine, law, economics are preferred
    • Use evaluation methods to complete daily strategy assessment of AI model quality and comb the types of bad cases to rate the quality of the results
    • Provide ideal AI model search results and elaborate logical reasons to support the evaluation given
    • Note: The output evaluation results will serve as an important basis for search strategy optimization and product function planning.
    • Work closely with the QA to provide feedback on data quality, SOP and guidelines to support overall project success
    • Perform other ad-hoc duties in relevant projects as assigned

    Qualifications

    What should I bring with me?

    Minimum Qualifications

    • Bachelor's degree or above
    • Excellent language and communication skills: proficient Korean and English at all levels (reading, writing, listening, speaking).
    • An in-depth understanding of local culture and familiarity with the internet usage habits of local users
    • Ability to learn fast, great flexibility in adapting to constant change
    • Excellent attention to details, precision and accuracy
    • Your ability to work in a high tempo environment, adapt, respond to day-to-day challenges of the role.
    • Your resilience and commitment to self-care to manage the emotional demands of the role.

    Preferred Qualifications

    • Overseas work/training experience or in a multi-cultural/multilingual environment is preferred
    • Knowledge of search engines and AI, familiarity with social media platforms
    • Familiarity with common office software, machine learning project experience is preferred

    Trust & Safety recognises that keeping our platform safe for TikTok communities is no ordinary job which can be both rewarding and psychologically demanding and emotionally taxing for some. This is why we are sharing the potential hazards, risks and implications in this unique line of work from the start, so our candidates are well informed before joining.
    We are committed to the wellbeing of all our employees and promise to provide comprehensive and evidence-based programs, to promote and support physical and mental wellbeing throughout each employee's journey with us. We believe that wellbeing is a relationship and that everyone has a part to play, so we work in collaboration and consultation with our employees and across our functions in order to ensure a truly person-centred, innovative and integrated approach.

    TikTok is dedicated to fostering an inclusive and diverse workplace that values and respects individuals with disabilities. Our commitment is to create equal opportunities and provide a supportive environment for all employees.

    TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

    Why you should apply for a job to TikTok:

  • 4.5/5 in overall job satisfaction
  • 4.5/5 in supportive management
  • 100% say women are treated fairly and equally to men
  • 100% would recommend this company to other women
  • 100% say the CEO supports gender diversity
  • Ratings are based on anonymous reviews by Fairygodboss members.
  • Employee well-being is supported via hybrid work, short-term counseling through our EAP and a premium subscription to Headspace.
  • We embrace diversity across all dimensions and provide employees with 9 employee resource groups globally, including our WOMEN ERG.
  • Comprehensive parental leave policy as well as fertility treatment through healthcare providers with a $20,000 lifetime maximum.