1,794 jobs for "Data Engineer - Data Platform"

ETS Principal Solution Engineer-Cloud Core & Accounting Platforms

At Navy Federal Credit Union - Vienna

Posted on Nov 4

View job Apply on company site

Integration Engineer 4

At Capital One - Richmond · McLean

Posted on Oct 23

View job Apply on company site

Senior Software Engineer, AI Tools - Special Projects

At Apple - Cupertino

Posted on Oct 19

View job Apply on company site

Principal Engineer, Apple Cloud Object Storage (ACOS), Storage Infrastructure

At Apple - Seattle

Posted on Oct 17

View job Apply on company site

Operations, Controls Engineer - Manchester

At Equinix - Remote / Flexible

Posted on Oct 16

View job Apply on company site

Senior Software Engineer, Apple Services Engineering

At Apple - Cupertino

Posted on Oct 14

View job Apply on company site

Integration Engineer 4

At Capital One - Richmond · McLean

Posted on Oct 11

View job Apply on company site

Software Engineer, Big Data - Apple Services Engineering

At Apple - Seattle

Posted on Oct 10

View job Apply on company site

Service Reliability Engineer (SRE)

At Apple - Seattle

Posted on Oct 9

View job Apply on company site

Integration Engineer 4 - Storage Engineer

At Capital One - Riverwoods · Plano

Posted on Oct 9

View job Apply on company site

Operations, Controls Engineer - London, Harbour Exchange

At Equinix - Remote / Flexible

Posted on Oct 7

View job Apply on company site

Senior Software Engineer, Customer Data Protection

At Apple - London

Posted on Oct 19

View job Apply on company site

Finance Machine Learning Engineer - Tech Lead

At Apple - Austin

Posted on Oct 17

View job Apply on company site

Software Development Engineer, System Analytics & Intelligence (SAIL)

At Apple - Cupertino

Posted on Oct 15

View job Apply on company site

Software Engineer II

At Mastercard - Pune

Posted on Oct 15

View job Apply on company site

UAS Data Links Communications Test Engineer

At Leidos - Huntsville

Posted on Sep 3

View job Apply on company site

Principal Software Engineer

At Leidos - Laurel

Posted on Aug 27

View job Apply on company site

Software Engineer (Salesforce)

At Delta Dental - Alpharetta

Posted on Nov 5

View job Apply on company site

Software Engineer (Salesforce)

At Delta Dental - Oakland

Posted on Nov 5

View job Apply on company site

Treasury Senior Solutions Architect

At Mizuho Americas

Posted on Sep 26

View job Apply on company site

Apple

Principal Engineer, Apple Cloud Object Storage (ACOS), Storage Infrastructure

Seattle, WA$205,400 – $374,300Posted 22 days ago

Apply on company site View full job

Why you should apply for a job to Apple:

Ranked as one of the Best Technology Companies in 2020
3.7/5 in overall job satisfaction
3.1/5 in supportive management
66% say women are treated fairly and equally to men
65% would recommend this company to other women
66% say the CEO supports gender diversity

Ratings are based on anonymous reviews by Fairygodboss members. See all reviews ›

ACOS is Apple's geo-distributed, exabyte-scale object storage service. It serves billions of requests per day for iCloud, Apple Music, Apple TV, Apple Maps, and Apple's internal data and analytics platforms. It provides 11-nines of durability and 4-nines of availability.

The ACOS Storage Infrastructure team owns how data is encoded, placed, verified, repaired, and reclaimed inside a storage cluster. This includes erasure and replicated encoding schemes, data placement and rebalancing optimization, compaction, scrubbing and repair, durability modeling, performance tiering, and the supply chain that keeps available capacity in front of customer demand. In practice, this team determines what storage costs, how it survives in the face of software and hardware failures, and how fast it is served.

Description

This is a role for an engineer who has designed, shipped, and operated the data path of a storage system at exabyte scale.

The next big challenge here is to support the industry's transition to much denser drives. This means capacity per drive is growing far faster than IOPS per drive, and maintenance operations - sealing, compaction, scrubbing, repair, rebalancing, cross-region replication - consumes that increasingly scarce IOPS budget. This is made harder by the growing demand for high-performance storage tiers by Data and AI workloads

You will own the technical agenda for solving that, across four areas:

* Storage Efficiency. Drive cost per usable byte down further: reduce replication factor without conceding the durability bar, reclaim storage overheads for compaction and other processes, and make placement maximize both space and IOPS utilization. Land support for denser and heterogeneous drive generations (CMR, HAMR, SMR) without letting IOPS-per-TB become the binding constraint on the fleet.

* Storage Integrity. Guarantee 11-nines of durability in production in the face of software and hardware failures. Own detection and repair end to end: balance detection latency against the IOPS cost of scrubbers and ensure correctness of the encode/decode/repair/rebalance paths.

* Storage Performance. Deliver differentiated performance tiers. That means improving tail latency and IOPS for the standard performance tier, while also introducing high-performance SSD-backed tiers for data and AI workloads.

* Capacity Planning and Management. Make supply closely track customer demand. Own demand forecasting, drive-generation transitions, capacity on-boarding and decommissioning, quota and rate-limit commitments, and the release value when the system is oversubscribed.

Your influence will extend well beyond ACOS. You will be the person Apple's storage organization, its hardware engineering partners, and its executives rely on for judgment on encoding, durability, and fleet efficiency.","responsibilities":"Set the Technical Agenda. Own the multi-year architecture and roadmap for how ACOS encodes, places, and serves data. Identify and prioritize the problems that matter most.

Synthesize hardware trends (HAMR, SMR, disaggregation), research and industry practice (wide-stripe coding, disk-adaptive and temperature-adaptive redundancy, tiering), and workload evolution into a strategy that keeps our storage reliability and efficiency ahead of customer requirements.

Raise the Technical Bar. Mentor and grow the most senior engineers in the org. Lead design and development for our highest-consequence systems, and set high standards for the design and operations of our services.

Drive Alignment. Broker decisions across customers, partners (SRE, hardware, capacity), and stakeholders.

Preferred Qualifications

Experience building out a credible, funded, multi-year path to a materially lower cost per usable byte.

In-depth understanding of maintenance overhead per usable byte trending down as drive density goes up - support denser drives.

Experience with durability guarantees measured and guaranteed in production.

Knowledge of performance tiers in production that support AI/ML and data teams.

Understanding of capacity that tracks demand within a tight band.

Minimum Qualifications

15+ years in software development, with 10+ years designing, building, and operating large-scale distributed storage systems.

BS, MS, or PhD in Computer Science or a related field. A PhD in distributed systems or storage is a strong plus.

Proven track record of delivering storage systems at ~exabyte scale. Your past work should demonstrate depth in erasure coding, replication, data placement, repair and reconstruction, consistency models, and consensus protocols (e.g., Paxos, Raft).

Deep, hands-on expertise in the encoding layer specifically: Reed-Solomon and Local Reconstruction Codes, wide-stripe and geo-distributed coding schemes, and the ability to reason quantitatively about the resulting durability, availability, repair-bandwidth, and IOPS trade-offs.

Familiarity with the architecture of industry-leading storage systems (e.g., Google Colossus, Ceph/RADOS, Azure Blob Storage, Amazon S3, Meta f4/Tectonic, HDFS).

Experience with the modern drive landscape and its implications: QLC and dense flash, SMR, HAMR, heterogeneous fleets, declining IOPS per TB, and disaggregated storage and compute.

Experience designing storage for high-performance workloads, particularly AI/ML or large-scale analytics. Familiarity with the I/O patterns of training pipelines, data processing engines, and high-transaction databases.

Operational credibility: you have carried a pager for a storage system at scale, and your architectural judgment is shaped by having debugged data loss and availability incidents.

Exceptional ability to influence without authority, with a history of driving major technical decisions and aligning senior engineering leaders across a large organization.

Outstanding communication skills - able to distill trade-offs for an executive audience and to hold a deep technical debate with principal-level engineers.

Pay & Benefits

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $205,400 and $374,300, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

About Apple

Working at Apple means doing more than you ever thought possible and having more impact than you ever imagined.

Size: 10,000+ employees
Industry: Technology: Manufacturing

View company profile