Tech Expert/Backend Engineer - Global Live (LLM Model Serving)
Singapore
Why you should apply for a job to TikTok:
4.5/5 in overall job satisfaction
4.5/5 in supportive management
100% say women are treated fairly and equally to men
100% would recommend this company to other women
100% say the CEO supports gender diversity
Employee well-being is supported via hybrid work, short-term counseling through our EAP and a premium subscription to Headspace.
We embrace diversity across all dimensions and provide employees with 9 employee resource groups globally, including our WOMEN ERG.
Comprehensive parental leave policy as well as fertility treatment through healthcare providers with a $20,000 lifetime maximum.
#7402081703735855370
Position summary
ion of computing resources, minimizing response time, and maximizing throughput.
- Cross-Team Collaboration: Work closely with algorithm and business teams to facilitate the deployment of models into production and resolve issues that arise in the production environment.
- Technical Innovation: Continuously monitor and explore new technologies and methods in the AI field to drive technological advancement in model services.
Qualifications
Minimum Qualifications:
- Bachelor's degree or higher in Computer Science, Software Engineering, Artificial Intelligence, or related fields.
- 3+ years of relevant work experience, with experience in deploying and servicing large-scale machine learning models.
- Proficiency in mainstream deep learning frameworks (such as TensorFlow, PyTorch, DeepSpeed) and their deployment in production environments.
- Familiarity with model inference optimization techniques, such as quantization, distillation, distributed inference, ONNX, ZeRO, etc.
- Familiarity with online service tech stacks, such as RPC, Redis, Kafka, etc.
- Strong programming skills, proficient in Python, C++ or Golang, with a deep understanding of system performance optimization.
Preferred Qualification:
- Have LLMs deployment and optimization experience
Why you should apply for a job to TikTok:
4.5/5 in overall job satisfaction
4.5/5 in supportive management
100% say women are treated fairly and equally to men
100% would recommend this company to other women
100% say the CEO supports gender diversity
Employee well-being is supported via hybrid work, short-term counseling through our EAP and a premium subscription to Headspace.
We embrace diversity across all dimensions and provide employees with 9 employee resource groups globally, including our WOMEN ERG.
Comprehensive parental leave policy as well as fertility treatment through healthcare providers with a $20,000 lifetime maximum.