1,139 jobs for "Software Engineer - Data Platform"

Responsibilities

The TikTok Privacy and Security (PnS) R&D team creates privacy solutions that are intuitive for users, auditable for regulators, and sustainable for the company, making TikTok a platform where people can safely discover, create, and connect.

We build user-facing privacy features, including privacy settings, consent management, data access and export, and age-appropriate experiences. We protect personal data across its full lifecycle, from collection and transfer through access, storage, retention, and deletion. We develop the platforms, technical controls, and governance tools behind privacy protection and regulatory compliance in global markets, and we bring privacy-enhancing technologies and research into production at scale.
We tackle challenges unique to operating a platform at global scale: translating rapidly evolving laws and policies into reliable technical controls, providing transparency and auditability across highly complex data systems, supporting different regulatory requirements across regions, and making privacy protection work at the quality and speed production systems demand.

You will work across product privacy, data lifecycle management, data protection and residency, privacy engineering platforms, AI governance, and privacy-preserving technologies, using techniques including automated compliance enforcement, data lineage and taxonomy, differential privacy, trusted execution environments, AI fairness, and privacy protection for generative AI. The systems you build will protect hundreds of millions of people, and the privacy decisions you make will reach every one of them.

TikTok's Privacy and Security (PNS) Data Retention team makes sure that data across the platform is kept only as long as it is needed, and is then deleted reliably and verifiably. The data covers online services, offline warehouses, logs, backups, and ML training datasets. Global privacy rules keep getting stricter, and the data estate keeps growing to exabyte scale. The team owns the policies, platforms, and technical controls that turn retention commitments into guarantees we can enforce and audit.

As a Backend Engineer - Data Retention, you will design and build scalable, reliable, high-performance systems that manage the lifecycle of data at TikTok scale. That includes finding and classifying data, applying retention policies, running deletion, and proving that deletion happened. You will turn fast-changing privacy and regulatory requirements into concrete platform capabilities. You will work closely with storage infrastructure, data platform, ML platform, product, privacy, legal, and security teams to ship solutions across thousands of services and storage systems.

Responsibilities:
- Design and build large-scale data lifecycle management systems that enforce retention policies across heterogeneous storage: RDBMS, KV stores, caches, message queues, data warehouses (Hive/HDFS), object storage, logs, and backups.
- Build and run high-throughput deletion pipelines, such as TTL enforcement, user account deletion propagation, and partition and snapshot expiry. They must be correct, idempotent, and observable, and must not hurt the stability or performance of production systems.
- Build data discovery and inventory capabilities, including metadata collection, data lineage, and classification of personal and sensitive data. These keep retention policies accurately mapped to real storage assets.
- Build verification, auditing, and reporting systems that prove deletion is complete and on time. Provide evidence for internal audits and regulator inquiries.
- Support exception workflows such as legal holds, retention extensions, and policy approvals, with fine-grained access control and full audit trails.
- Work with ML platform teams to extend retention and deletion controls to training datasets, feature stores, and derived artifacts such as embeddings and model checkpoints.
- Work with privacy, legal, and compliance teams so that systems meet applicable regulations (GDPR, CCPA/CPRA, and other global and regional privacy laws) and TikTok's own data commitments.
- Help shape the technical roadmap for the data retention platform, and find and evaluate new techniques and tools that improve coverage, efficiency, and reliability at scale.

Qualifications

Minimum Qualifications
- Bachelor's or Master's degree in Computer Science or a related field.
- Strong background in large-scale distributed systems, databases, messaging and streaming systems (such as Kafka or Flink), and caching.
- Solid understanding of storage internals and data lifecycle concepts, such as TTL, compaction, partitioning, snapshots and backups, and consistency models.
- Experience building high-throughput batch or streaming data pipelines with strong correctness guarantees (idempotency, retries, exactly-once or at-least-once semantics).
- Experience with microservices architecture and containerization (Docker, Kubernetes).
- Experience with Agile development and DevOps practices.

Preferred Qualifications
- Hands-on industry experience, with significant time on storage infrastructure, data platforms, or privacy and data governance systems.
- Hands-on experience with data retention, data deletion, data inventory and classification, or data lineage systems at large internet scale.
- Familiarity with privacy regulations (GDPR, CCPA/CPRA) and industry standards (ISO/IEC 27001, ISO/IEC 27701, NIST Privacy Framework).
- Experience with big data ecosystems (Hive, Spark, HDFS, Iceberg/Hudi) and their data expiry and deletion mechanisms.
- Familiarity with privacy-enhancing technologies (PII detection, de-identification, pseudonymization, crypto-shredding).
- Publications, patents, or open-source contributions in data governance, privacy engineering, or storage systems.

Job Information

[For Pay Transparency] Compensation Description (annually)

The base salary range for this position in the selected city is $207480 - $368220 annually.

Compensation may vary outside of this range depending on a number of factors, including a candidate's qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.

Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure).

The Company reserves the right to modify or change these benefits programs at any time, with or without notice.

For Los Angeles County (unincorporated) Candidates:

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:

1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;

2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and

3. Exercising sound judgment.

Responsibilities

Qualifications

Qualifications

Minimum Qualifications
- Bachelor's or Master's degree in Computer Science or a related field.
- Strong background in large-scale distributed systems, databases, messaging and streaming systems (such as Kafka or Flink), and caching.
- Solid understanding of storage internals and data lifecycle concepts, such as TTL, compaction, partitioning, snapshots and backups, and consistency models.
- Experience building high-throughput batch or streaming data pipelines with strong correctness guarantees (idempotency, retries, exactly-once or at-least-once semantics).
- Experience with microservices architecture and containerization (Docker, Kubernetes).
- Experience with Agile development and DevOps practices.

Preferred Qualifications
- Hands-on industry experience, with significant time on storage infrastructure, data platforms, or privacy and data governance systems.
- Hands-on experience with data retention, data deletion, data inventory and classification, or data lineage systems at large internet scale.
- Familiarity with privacy regulations (GDPR, CCPA/CPRA) and industry standards (ISO/IEC 27001, ISO/IEC 27701, NIST Privacy Framework).
- Experience with big data ecosystems (Hive, Spark, HDFS, Iceberg/Hudi) and their data expiry and deletion mechanisms.
- Familiarity with privacy-enhancing technologies (PII detection, de-identification, pseudonymization, crypto-shredding).
- Publications, patents, or open-source contributions in data governance, privacy engineering, or storage systems.

About TikTok

TikTok is the leading destination for short-form mobile video and our mission is to inspire creativity and bring joy.

Size: 10,000+ employees
Industry: Technology: Consumer Internet

View company profile