1,672 jobs for "Senior Data Engineer"

Senior Software Engineer, Apple Data Platform

At Apple - Cupertino

Posted on Oct 19

View job Apply on company site

Data Engineer Senior (Python/SQL)

At PNC Financial Services Group - Lakewood

Posted on Nov 2

View job Apply on company site

Senior / Staff ML Engineer, Apple Data Platform

At Apple - Cupertino

Posted on Oct 19

View job Apply on company site

Senior Data Engineer, Retail Business Intelligence

At Apple

Posted on Oct 17

View job Apply on company site

Data Engineer Senior (Python/SQL)

At PNC Financial Services Group - Strongsville

Posted on Oct 30

View job Apply on company site

Data Engineer Senior (Python/SQL)

At PNC Financial Services Group - Farmers Branch

Posted on Oct 30

View job Apply on company site

Senior Associate Data Engineer

At Equinix - Remote / Flexible

Posted on Sep 29

View job Apply on company site

Senior Data Engineer

At Mastercard

Posted on Sep 18

View job Apply on company site

Senior Data Engineer

At Prudential Financial - Newark

Posted on Aug 8

View job Apply on company site

Senior Power System Engineer - Renewable & Data Center Integration

At Leidos - Remote / Flexible

Posted on Sep 19

View job Apply on company site

Data Engineer - Senior 7 (Data Modeler)

At Cummins - Pune

Posted on Sep 2

View job Apply on company site

Senior Data Engineer

At Bank of America - Jersey City · Charlotte

Posted on Sep 10

View job Apply on company site

Data Engineer 5 (Senior Manager, IC)-Risk Tech

At Capital One - McLean · Richmond

Posted on Sep 26

View job Apply on company site

Senior Software Development Engineer - Data

At TikTok - San Jose

Posted on Sep 1

View job Apply on company site

Senior Data Engineer - AI Infrastructure Integration, High Performance Compute

At Bank of America - New York · Jersey City

Posted on Aug 19

View job Apply on company site

Senior AI Engineer, Big Data & AI Solutions

At Mastercard - O'Fallon

Posted on Aug 15

View job Apply on company site

Senior Site Reliability Engineer - Data Infrastructure

At TikTok - Seattle

Posted on Feb 15

View job Apply on company site

Senior Data Engineer

At Mastercard - Pune

Posted on Aug 3

View job Apply on company site

Senior Associate, Data Governance & Metadata Engineer

At DTCC - Tampa

Posted on Oct 8

View job Apply on company site

Senior Data Engineer

At Health-E Commerce - Remote / Flexible

Posted on Jul 29

View job Apply on company site

Apple

Senior Software Engineer, Apple Data Platform

Cupertino, CA$184,700 – $324,800Posted 19 days ago

Apply on company site View full job

Why you should apply for a job to Apple:

Ranked as one of the Best Technology Companies in 2020
3.7/5 in overall job satisfaction
3.1/5 in supportive management
66% say women are treated fairly and equally to men
65% would recommend this company to other women
66% say the CEO supports gender diversity

Ratings are based on anonymous reviews by Fairygodboss members. See all reviews ›

We are seeking extraordinary software engineers to work on Apache DataFusion Comet, the open-source accelerator for Apache Spark that Apple created and donated to the Apache Software Foundation. You are passionate about pushing distributed query engines to their limits and getting every ounce of performance out of them, while matching Spark's results exactly. We are looking for engineers with in-depth knowledge of Spark internals and of related technologies such as Apache Iceberg, Parquet, Arrow, and DataFusion. You are also excited about working in the open, collaborating with teams across Apple that run Spark at scale and contributing upstream to these open-source communities.

Description

As an engineer on our team, you will advance Apple Data Platform by making Apache Spark faster and more efficient with Apache DataFusion Comet. You will design and implement operators and expressions in a native language on Apache DataFusion and Apache Arrow, extend Comet's Spark integration across Spark versions, and accelerate reads and writes of Apache Iceberg and Apache Parquet data, all while keeping results identical to Spark's. You'll collaborate closely with a dedicated team of open-source data experts, including committers to Apache Spark, DataFusion, and Iceberg, among others, and contribute that work upstream. You will also profile and benchmark real workloads and tune memory, shuffle, and I/O to roll Comet out reliably across both data centers and cloud services. Your work will directly contribute to the resilience, scalability, and performance of systems that support millions of users worldwide.

","responsibilities":"What you can expect to do and contribute to:

Develop and deploy new features for Apple's internal data platform.

Contribute regularly to open-source projects.

Collaborate with cross-functional teams to design and implement automation tools that streamline operations and reduce manual intervention.

Optimize our cloud-based services so they scale effectively, handling increasing loads while maintaining high performance.

Innovate on API development and integration, enabling seamless communication between our applications and services.

This is an opportunity to join a dynamic and evolving team where your contributions will shape the future of Apple's technology landscape.

Preferred Qualifications

Experience with columnar or vectorized query execution, or with performance profiling and optimization of query engines.

Good knowledge of Apache Iceberg and Apache Parquet internals.

Experience working on or building Spark connectors to external data sources.

Knowledge of Kubernetes, or other compute platforms.

Minimum Qualifications

3+ years of professional software engineering experience.

A proven track record of building distributed systems.

Contributor or committer to Apache Spark and/or Apache DataFusion, Comet.

BS, MS, or PhD in Computer Science or a related field, or equivalent practical experience.

Pay & Benefits

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $184,700 and $324,800, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

About Apple

Working at Apple means doing more than you ever thought possible and having more impact than you ever imagined.

Size: 10,000+ employees
Industry: Technology: Manufacturing

View company profile