139 jobs for "Product QA Engineer"

The Apple Knowledge Quality Team is building the next-generation of machine learning solutions for Knowledge Q&A at Apple and help power features including Siri and Spotlight. The features we build are redefining how hundreds of millions of people use their computers and mobile devices to search and find what they are looking for. As part of this group, you will work with one of the most exciting high performance computing environments, with petabytes of data, millions of queries per second, and have an opportunity to imagine and build products that delight our customers every single day.

Description

The Knowledge Quality team is looking for extraordinary Machine Learning engineers to join a team of world-experts on Large-Scale Data Management and Machine Learning Systems. Together, you will be pushing the boundaries of Knowledge Question Answering in Siri. As part of the Knowledge Quality team, you will design and develop features for a platform that touches upon large-scale data management, machine-learning and deep learning systems over graph data and web documents. You will have the outstanding opportunity to inform product evolution through measurement, evaluation, and analysis of the user experience. You will partner with cross-functional teams to change how hundreds of millions of people use their computers and mobile devices to search and provide users with results that best satisfy their information seeking needs.

Preferred Qualifications

MS degree with 6+ years of industry experience building and scaling ML/AI systems, OR PhD degree with 3+ years of industry experience in production ML environments

Proven track record designing, deploying, and maintaining large-scale distributed ML systems serving millions of QPS (queries per second)

Experience with A/B testing, experimentation frameworks, and data-driven product iteration at scale

Experience designing human-in-the-loop evaluation pipelines and leveraging user feedback to improve model performance

Hands-on experience with LLM deployment, prompt engineering, fine-tuning, RAG (Retrieval-Augmented Generation), or other generative AI technologies in production

Experience building model monitoring, observability, and quality assurance systems for production ML services

Experience optimizing ML systems for latency, throughput, and cost at scale

Track record of shipping ML-powered features that measurably improved user experience for consumer-facing products

Strong product intuition and ability to translate business requirements into technical solutions

Minimum Qualifications

degree in Computer Science, Machine Learning, or related field with 2+ years of industry experience building production ML/AI systems, OR PhD degree in a related field

Proficiency in mainstream programming languages such as Python, Scala, and Go

Experience building and maintaining large-scale data systems, knowledge graphs, and end-to-end ML pipelines in production, ideally using the Apache software stack (e.g., Spark)

Hands-on experience with machine learning frameworks such as PyTorch or TensorFlow in production environments

Experience with natural language processing, statistical data analysis, and model evaluation methodologies

Demonstrated ability to collaborate with cross-functional teams including product, engineering, and data science

Experience with CI/CD pipelines, model deployment, and monitoring solutions

Pay & Benefits

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $142,300 and $263,300, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

About Apple

Working at Apple means doing more than you ever thought possible and having more impact than you ever imagined.

Size: 10,000+ employees
Industry: Technology: Manufacturing

View company profile