Backend Engineer (Machine Learning Systems) - TikTok Large Model Platform

That's how we drive impact - for ourselves, our company, and the communities we serve.
Join us.

About the Team
The Applied Machine Learning - Machine Learning (ML) Systems team provides End to End (E2E) machine learning experience and machine learning resources for the company. The team builds heterogeneous ML training and inference systems based on GPU and advanced chip technology and advances the state-of-the-art of ML systems technology to accelerate models such as stable diffusion and language modelling. The team is also responsible for the research and development of hardware acceleration technologies for cloud computing, via technologies such as distributed systems, compilers, HPC, and RDMA networking. The team is reinventing the ML infra for large-scale language models.

Responsibilities:
Responsible for the machine learning system development of the company's large-scale models, researching new applications and solutions of related technologies in areas such as search, recommendation, advertising, content creation, conversation, and customer service, meeting the growing demand for intelligent interaction from users, and comprehensively improving users' lifestyles and communication methods in the future world.

The main work directions include:

• Responsible for the design and development of the architecture of large-scale machine learning systems, solving technical difficulties such as high concurrency, high reliability, and high scalability of the system;
• Covering various sub-directions of machine learning system, including resource scheduling, model training, model inference, data management, and workflow orchestration;
• Working closely with the algorithm teams to optimize the algorithm and system jointly;
• Research, design, and develop computer and network software or specialised utility programs;
• Analyse user needs and develop software solutions, applying principles and techniques of computer science, engineering, and mathematical analysis;
• Update software, enhances existing software capabilities, and develops and direct software testing and validation procedures;
• Work with computer hardware engineers to integrate hardware and software systems and develop specifications and performance requirements;

Qualifications

• Bachelor's degree or above, major in Computer Science, computer engineering or related;
• At least 3 years or more working experiences;
• Excellent coding skills, solid foundation in data structures and basic algorithms;
• Proficient in at least one of the mainstream server-side programming languages such as Golang / Python / Java;
• Familiar with Linux development environment;
• Deep understanding of database technologies such as MySQL / PostgreSQL / MongoDB, middleware technologies such as Redis / Kafka;
• Preferred to have a strong understanding of the principles of distributed systems, and have participated in the design, development, and maintenance of large-scale distributed systems with good knowledge of Kubernetes, Prometheus, Containerisation, Continuous Integration & Continuous Distribution;
• Strong sense of responsibility, good learning ability, communication ability, and self-motivation;
• Experience in the machine learning & cloud computing & data pipeline domain is a plus;

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.