1,108 jobs for "Design Verification Engineer"

CPU Microarchitect/RTL Engineer - Execution, Load/Store

At Apple - Beaverton

Posted on Oct 3

View job Apply on company site

CPU Microarchitect/RTL Engineer - Execution, Load/Store

At Apple - Beaverton

Posted on Oct 3

View job Apply on company site

CPU Cache Microarchitect/RTL Engineer

At Apple - Santa Clara

Posted on Sep 28

View job Apply on company site

Software Engineer I: Jasper R&D

At Cadence Design Systems - Belo Horizonte

Posted on Aug 24

View job Apply on company site

Staff Engineer, Memory Layout Design

At Ansys - Noida

Posted on Oct 30

View job Apply on company site

iPhone System Engineer - Power & Charging

At Apple - Austin

Posted on Oct 16

View job Apply on company site

iPhone System Engineer - Power & Charging

At Apple - Austin

Posted on Oct 16

View job Apply on company site

GPU Performance Analysis Engineer

At Apple - San Diego

Posted on Oct 11

View job Apply on company site

Software Test Engineer (AI), TikTok Search

At TikTok

Posted on Oct 6

View job Apply on company site

Lead, Infrastructure Security Engineer - Customer Identity & Access Management

At Prudential Financial - Newark

Posted on Oct 3

View job Apply on company site

Senior Systems Engineer

At Leidos - Huntsville

Posted on Sep 18

View job Apply on company site

Sr. Principal Software Engineer, Physical Verification

At Cadence Design Systems - San Jose

Posted on Sep 17

View job Apply on company site

Lead Systems Engineer

At Leidos - Gaithersburg

Posted on Aug 24

View job Apply on company site

Senior Software Engineer

At Leidos - Annapolis Junction

Posted on Jul 23

View job Apply on company site

EPC Transmission Line Engineer

At Leidos - Remote / Flexible

Posted on Oct 23

View job Apply on company site

Lead Product Engineer

At Cadence Design Systems - San Jose

Posted on Oct 21

View job Apply on company site

Lead Systems Integration & Test Engineer

At Leidos - Gaithersburg

Posted on Oct 20

View job Apply on company site

Lead Systems Integration & Test Engineer

At Leidos - Egg Harbor Township

Posted on Oct 20

View job Apply on company site

Lead Electrical Engineer - Input Engineering

At Apple - Cupertino

Posted on Oct 16

View job Apply on company site

Software Engineer II: AI Inhouse Adoption

At Cadence Design Systems - Belo Horizonte

Posted on Sep 29

View job Apply on company site

TikTok

Software Test Engineer (AI), TikTok Search

SingaporePosted Oct 6, 2026

Apply on company site View full job

Why you should apply for a job to TikTok:

4.5/5 in overall job satisfaction
4.5/5 in supportive management
100% say women are treated fairly and equally to men
100% would recommend this company to other women
100% say the CEO supports gender diversity

Ratings are based on anonymous reviews by Fairygodboss members. See all reviews ›

Responsibilities

The TikTok Search Engineering Test Team owns the end-to-end quality of TikTok's global search experience-from query understanding, retrieval, and ranking to generative search experiences (LLM Answers and RAG) and search safety. TikTok Search operates across hundreds of markets and languages, connecting billions of users every day with the videos, creators, products, and information they are looking for. Every relevance regression, latency fluctuation, or unsafe result directly impacts user trust and business outcomes.

We are redefining how search quality is built. By leveraging Large Language Models (LLMs), AI agents, and intelligent automation, we are reimagining the entire search testing lifecycle-from query set construction and relevance evaluation to ranking diagnostics, LLM-generated answer evaluation, RAG pipeline verification, and search safety red teaming.

Our mission is to build next-generation AI-powered evaluation and testing capabilities that enable TikTok Search to iterate faster, ship smarter, and remain trustworthy at global scale. You will work at the intersection of Search Engineering, Quality Engineering, and Generative AI, helping shape the future of AI-native Search Quality at TikTok.

As a Software Test Engineer (AI) on the Search team, you will:
- Design and deliver AI-powered testing and evaluation solutions for TikTok Search, covering query understanding, retrieval, ranking, generative search (LLM Answers and RAG), personalization, and multimodal and vertical search scenarios such as video, image, e-commerce, user, and creator search.
- Build LLM-based evaluation pipelines for search relevance, answer faithfulness, groundedness, freshness, coverage, diversity, and safety; construct and continuously maintain multilingual, multi-market query sets and golden datasets that reflect real user intent.
- Drive change impact analysis across the search stack-including index, retrieval, ranking models, and prompt and model changes-through AI-assisted diff analysis, offline replay, side-by-side (SBS) evaluation, and interleaving experiments; strengthen release quality gates and pre-launch verification capabilities.
- Partner closely with search engineering, algorithm, product, and content operations teams to identify quality and engineering productivity pain points across the search lifecycle, propose practical AI-powered solutions, and drive them into production.
- Improve engineering productivity for the search organization by building AI agents and tooling for automated test case generation, log-driven bug analysis, root-cause attribution, and self-healing regression suites.

Qualifications

Minimum Qualifications
- Bachelor's degree or above in Computer Science, Software Engineering, Information Retrieval, Data Science, or a related technical discipline.
- Experience in software quality assurance or software testing, preferably for search, recommendation, ranking, content understanding, or other large-scale data- or algorithm-driven systems.
- Solid understanding of software testing methodologies, debugging, and quality assurance best practices across the software development lifecycle, including offline evaluation, online A/B testing, and production monitoring.
- Familiarity with distributed systems and search and recommendation infrastructure fundamentals (e.g. inverted indexes, vector indexes, retrieval, ranking, embeddings), plus basic knowledge of iOS and/or Android as search entry points.
- Hands-on experience in one or more testing domains, including automation testing, performance and stress testing, algorithm evaluation, or test platform and tool development.
- Strong interest in Generative AI and Large Language Models, with an understanding of common LLM capabilities, evaluation paradigms (e.g. LLM-as-a-Judge, RAG evaluation, and human evaluation), and real-world search applications.

Preferred Qualifications
- Proficiency in one or more programming languages such as Python, Go, Java, or C++.
- Hands-on experience evaluating or testing search, recommendation, ranking, or LLM and RAG systems, including relevance labeling, SBS evaluation, NDCG, MRR, and Recall analysis, faithfulness and groundedness measurement, or hallucination detection.
- Experience developing test automation frameworks, evaluation platforms, query set management tools, or engineering productivity tools for search and algorithm teams.
- Hands-on experience with Generative AI-related projects, including LLM application development, AI agent evaluation, model evaluation, AI-assisted testing, prompt engineering, fine-tuning, or building AI testing frameworks.
- Experience leveraging AI tools (e.g. LLMs, AI coding assistants, or AI agents) to improve testing efficiency, automate test case generation, bug analysis, or search quality workflows.
- Experience with multilingual and cross-market quality work, content safety testing, or vertical search domains such as e-commerce, video, or creator search.

Responsibilities

Qualifications

Qualifications

Minimum Qualifications
- Bachelor's degree or above in Computer Science, Software Engineering, Information Retrieval, Data Science, or a related technical discipline.
- Experience in software quality assurance or software testing, preferably for search, recommendation, ranking, content understanding, or other large-scale data- or algorithm-driven systems.
- Solid understanding of software testing methodologies, debugging, and quality assurance best practices across the software development lifecycle, including offline evaluation, online A/B testing, and production monitoring.
- Familiarity with distributed systems and search and recommendation infrastructure fundamentals (e.g. inverted indexes, vector indexes, retrieval, ranking, embeddings), plus basic knowledge of iOS and/or Android as search entry points.
- Hands-on experience in one or more testing domains, including automation testing, performance and stress testing, algorithm evaluation, or test platform and tool development.
- Strong interest in Generative AI and Large Language Models, with an understanding of common LLM capabilities, evaluation paradigms (e.g. LLM-as-a-Judge, RAG evaluation, and human evaluation), and real-world search applications.

Preferred Qualifications
- Proficiency in one or more programming languages such as Python, Go, Java, or C++.
- Hands-on experience evaluating or testing search, recommendation, ranking, or LLM and RAG systems, including relevance labeling, SBS evaluation, NDCG, MRR, and Recall analysis, faithfulness and groundedness measurement, or hallucination detection.
- Experience developing test automation frameworks, evaluation platforms, query set management tools, or engineering productivity tools for search and algorithm teams.
- Hands-on experience with Generative AI-related projects, including LLM application development, AI agent evaluation, model evaluation, AI-assisted testing, prompt engineering, fine-tuning, or building AI testing frameworks.
- Experience leveraging AI tools (e.g. LLMs, AI coding assistants, or AI agents) to improve testing efficiency, automate test case generation, bug analysis, or search quality workflows.
- Experience with multilingual and cross-market quality work, content safety testing, or vertical search domains such as e-commerce, video, or creator search.

About TikTok

TikTok is the leading destination for short-form mobile video and our mission is to inspire creativity and bring joy.

Size: 10,000+ employees
Industry: Technology: Consumer Internet

View company profile