663 jobs for "Lead Engineer - Infrastructure"

Software Engineer, Ads ML Infrastructure

At TikTok - San Jose

Posted on Apr 2

View job Apply on company site

(General Hire)Tech Lead, Machine Learning Engineer, TikTok Recommendation

At TikTok - San Jose

Posted on Apr 19

View job Apply on company site

Lead Performance Test Engineer

At DTCC - Coppell · Tampa

Posted on Oct 31

View job Apply on company site

Lead IT Security Engineer

At DTCC - Hyderabad

Posted on Oct 15

View job Apply on company site

Lead IT Security Engineer

At DTCC - Jersey City · Tampa

Posted on Sep 25

View job Apply on company site

Sr. GIS Solution Engineer - AEC and Infrastructure

At Esri - Rotterdam

Posted on Sep 18

View job Apply on company site

Lead Application Support Engineer

At DTCC - Chennai

Posted on Sep 9

View job Apply on company site

Lead Software Development Engineer in Test

At DTCC - Tampa · Jersey City

Posted on Sep 3

View job Apply on company site

Lead IT Security Engineer (Cybersecurity & Platform Security)

At DTCC - London

Posted on Sep 2

View job Apply on company site

Lead Business Intelligence Engineer

At DTCC - Tampa

Posted on Jul 9

View job Apply on company site

Lead Application Support Engineer (6AM to 3PM)

At DTCC - Makati City

Posted on Jun 10

View job Apply on company site

Lead Application Support Engineer (12-8pm EST Shift)

At DTCC - Coppell

Posted on Jun 10

View job Apply on company site

Lead Application Support Engineer

At DTCC - Makati City · Hyderabad

Posted on May 14

View job Apply on company site

Lead Application Support Engineer

At DTCC - Coppell

Posted on Apr 23

View job Apply on company site

Lead Software Development Engineer in Test

At DTCC - Tampa · Dallas

Posted on Mar 3

View job Apply on company site

Systems Engineer IV - Cloud Engineering Lead

At Leidos - North Charleston

Posted on Jul 9

View job Apply on company site

Systems Engineer IV - Cloud Engineering Lead

At Leidos - Charleston

Posted on Jul 9

View job Apply on company site

Software Engineer Project Intern (Model Infrastructure) - 2026 Start (BS/MS)

At TikTok - San Jose

Posted on Apr 4

View job Apply on company site

Chief Engineer - Critical Power Solutions

At Mitsubishi Electric Power Products - Warrendale

Posted on May 15

View job Apply on company site

Lead System Integration and Test Engineer

At Leidos - Gaithersburg

Posted on Oct 20

View job Apply on company site

TikTok

Software Engineer Project Intern (Model Infrastructure) - 2026 Start (BS/MS)

San JosePosted Apr 4, 2026

Apply on company site View full job

Why you should apply for a job to TikTok:

4.5/5 in overall job satisfaction
4.5/5 in supportive management
100% say women are treated fairly and equally to men
100% would recommend this company to other women
100% say the CEO supports gender diversity

Ratings are based on anonymous reviews by Fairygodboss members. See all reviews ›

Responsibilities

About the Team
The TikTok Model Infrastructure team is the core engine powering the world's most engaged "For You" feed. We focus on the engineering efficiency and architectural evolution of recommendation models at an unprecedented scale. As we lead the industry's shift toward LLM2Rec and Large Recommendation Models (LRM), our mission is to build ultra-high-performance infrastructure that bridges the gap between massive data scale and extreme algorithmic complexity.
We tackle the industry's most demanding "frontier" challenges: managing Petabyte-scale distributed embedding states, optimizing thousand-node GPU clusters, and perfecting real-time Sparse/Dense streaming. Our work ensures that models with hundreds of billions of dense parameters-on par with the world's largest LLMs-can operate with millisecond-level latency.

We are seeking Software Engineering Interns to join the Model Infra team to redefine the performance boundaries of recommendation systems. In this role, you will focus on the efficiency of the entire model lifecycle. You will work on the convergence of generative AI and recommendation architecture, optimizing everything from the raw throughput of multi-billion parameter dense blocks to the efficient retrieval of sparse features across massive distributed memory fabrics.

As a project intern, you will have the opportunity to engage in impactful short-term projects that provide you with a glimpse of professional real-world experience. You will gain practical skills through on-the-job learning in a fast-paced work environment and develop a deeper understanding of your career interests.

Applications will be reviewed on a rolling basis - we encourage you to apply early.

Responsibilities
- Engineering Efficiency at Scale: Drive the optimization of training and inference pipelines to maximize hardware utilization (MFU/HFU) for models featuring hundreds of billions of dense parameters.
- LLM2Rec Infrastructure: Architect specialized systems to support the integration of LLMs into the recommendation stack, focusing on memory-efficient attention mechanisms and advanced KV cache management for long-sequence user modeling.
- Massive Sparse & Dense Streaming: Build and optimize high-concurrency engines for Petabyte-scale streaming training, handling continuous parameter updates and high-frequency data ingestion without compromising stability.
- Hardware-Aware Co-Design: Work closely with researchers to design next-generation recommendation architectures optimized for modern GPU/NPU interconnects, ensuring high-bandwidth utilization across the cluster.
- Distributed State Management: Innovate on how we store and synchronize massive model states across heterogeneous memory hierarchies (HBM, DDR, and NVMe).

Qualifications

Minimum Qualification(s)
- Currently pursuing an Undergraduate/Master in Software Development, Computer Science, Computer Engineering, or a related technical discipline.
- Strong programming skills in C++ and Python.
- Solid understanding of Computer Architecture and the GPU software stack (CUDA, Triton, or NCCL).
- Experience with deep learning frameworks (e.g., PyTorch, TensorFlow) and a desire to "look under the hood" of model execution runtimes.
- A strong interest in solving system-level bottlenecks in large-scale distributed environments.

Preferred Qualification(s)
- Experience with Transformer-based architectures, 3D parallelism (TP/PP/DP).
- Deep understanding of the torch.compile stack, including TorchDynamo (graph acquisition) and TorchInductor (lowering).
- Hands-on experience writing high-performance kernels or optimizing collective communication (e.g., customizing NCCL/UCX).
- Familiarity with RDMA networking, high-performance storage, or specialized Parameter Server architectures.
- Success in programming competitions (ACM-ICPC) or contributions to prominent open-source AI infrastructure or high-performance computing projects.

Responsibilities

Qualifications

Qualifications

Minimum Qualification(s)
- Currently pursuing an Undergraduate/Master in Software Development, Computer Science, Computer Engineering, or a related technical discipline.
- Strong programming skills in C++ and Python.
- Solid understanding of Computer Architecture and the GPU software stack (CUDA, Triton, or NCCL).
- Experience with deep learning frameworks (e.g., PyTorch, TensorFlow) and a desire to "look under the hood" of model execution runtimes.
- A strong interest in solving system-level bottlenecks in large-scale distributed environments.

Preferred Qualification(s)
- Experience with Transformer-based architectures, 3D parallelism (TP/PP/DP).
- Deep understanding of the torch.compile stack, including TorchDynamo (graph acquisition) and TorchInductor (lowering).
- Hands-on experience writing high-performance kernels or optimizing collective communication (e.g., customizing NCCL/UCX).
- Familiarity with RDMA networking, high-performance storage, or specialized Parameter Server architectures.
- Success in programming competitions (ACM-ICPC) or contributions to prominent open-source AI infrastructure or high-performance computing projects.

About TikTok

TikTok is the leading destination for short-form mobile video and our mission is to inspire creativity and bring joy.

Size: 10,000+ employees
Industry: Technology: Consumer Internet

View company profile