8 jobs for "Software Engineer Manager: Agentic Evaluation Platform"

AI Engineer 5 (Gen AI SDK: Agentic AI, Guardrails, Evaluation)

At Capital One - New York · San Francisco

Posted on Oct 19

View job Apply on company site

Software Engineer II - AI Platforms

At Mastercard - Atlanta

Posted on Nov 5

View job Apply on company site

Senior Software Engineer - AI Platforms

At Mastercard - Atlanta

Posted on Nov 5

View job Apply on company site

Software Engineer II - AI Platforms

At Mastercard - Atlanta

Posted on Nov 5

View job Apply on company site

Software Engineer, Triage Services

At Apple - Cupertino

Posted on Oct 19

View job Apply on company site

Full Stack Developer : Agentic AI

At Apple - Haifa

Posted on Oct 16

View job Apply on company site

Full Stack Developer : Agentic AI

At Apple - Haifa

Posted on Oct 16

View job Apply on company site

Full-stack Engineer 4

At Capital One - Plano · McLean

Posted on Oct 28

View job Apply on company site

Apple

Software Engineer, Triage Services

Cupertino, CA$129,300 – $225,300Posted 21 days ago

Apply on company site View full job

Why you should apply for a job to Apple:

Ranked as one of the Best Technology Companies in 2020
3.7/5 in overall job satisfaction
3.1/5 in supportive management
66% say women are treated fairly and equally to men
65% would recommend this company to other women
66% say the CEO supports gender diversity

Ratings are based on anonymous reviews by Fairygodboss members. See all reviews ›

The System Triage Services team builds mission-critical applications that help detect, analyze, and classify low-level software crashes across all Apple platforms. You will design and build the next generation of AI-powered triage solutions, which serves as the first line of defense for all technologies developed by Core OS.

This role blends distributed systems engineering with hands-on agent development, tackling problems in reliability, scale, and system design alongside applied AI. If you want to understand operating systems at a deep level and are motivated by shipping work with measurable, visible impact, this role is for you!

Description

You will design and build agentic systems that transform how Core OS triages software bugs and features at scale - building production-grade infrastructure that runs AI/ML workloads reliably and improves over time through rigorous evaluation and feedback loops. The goal is to make autonomous triage a dependable, first-class part of how Core OS ships and debugs software. You'll work across the build and integration lifecycle, agent orchestration, and the infrastructure that connects them, partnering with project managers and engineering teams across Software, Hardware, and Silicon groups to turn complex triage requirements into resilient systems.

","responsibilities":"Design, build, and maintain AI agent workflows that automate low-level software triage and root-cause analysis routing at scale.

Evaluate and improve agent reliability - including prompt design, tool-calling accuracy, guardrails, and regression testing.

Instrument agent pipelines end-to-end so failures, drift, and low-confidence routing decisions surface before reaching engineers.

Collaborate with Core OS software teams to identify automation opportunities and refine agent behavior through feedback and evaluation.

Own the full lifecycle of production agents - from prototype to hardened service - including on-call ownership of triage-critical infrastructure, and mentor other engineers on agent design and evaluation.

Preferred Qualifications

Master's degree in Computer Science, Data Engineering, or a related field.

1+ year developing production-grade agentic systems.

Strong collaboration and communication skills working across multi-domain software engineering teams.

Experience with large-scale telemetry or observability systems feeding automated decision-making.

Experience shipping tools adopted by engineering teams beyond your own.

Background in kernel or OS-level debugging, crash analysis, or root-cause investigation.

Minimum Qualifications

Programming experience in Python

Experience building scalable data platforms and distributed systems.

Experience with LLM and agent development.

Knowledge of RAG architectures, embedding generation, vector databases, and AI data preparation for agentic workflows.

Familiarity with eval frameworks for agent quality (offline benchmarks, drift detection, confidence scoring).

Bachelor's degree in Computer Science, Data Engineering, or a related field.

Pay & Benefits

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $129,300 and $225,300, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

About Apple

Working at Apple means doing more than you ever thought possible and having more impact than you ever imagined.

Size: 10,000+ employees
Industry: Technology: Manufacturing

View company profile