Platform and EngOps Engineer - Cluster Operations

NVIDIA

2.7

(9)

Santa Clara, CA

#JR1990112

Position summary

cted via NVLink and InfiniBand.

What you will be doing:

  • Develop automated tools to efficiently deploy, provision, and maintain extensive GPU clusters interconnected via NVLink and InfiniBand

  • Implement modern DevOps tools to automate software updates, perform maintenance tasks, and monitor cluster availability, ensuring seamless operations.

  • Take ownership of daily cluster failures and issues, troubleshooting them promptly to maintain optimal cluster availability and performance.

  • Manage the rollout and rollback of cluster software and firmware updates, ensuring smooth transitions and minimal disruptions.

  • Collaborate effectively with dynamic Engineering and Product Teams across multiple time zones to align cluster operations with evolving project requirements.

What we need to see:

  • BS or MS in Computer Science, Computer Engineering, Electrical Engineering, or a related field, or equivalent experience.

  • 5+ years of hands-on experience in deploying and administrating clusters, servers, switches, and related infrastructure.

  • Automation expert with hands on skills in Ansible, Python and Shell Scripting.

  • Deep understanding of operating systems, computer networks, and high-performance applications.

  • Proven ability to work effectively with developers and test engineers across different teams and time zones.

  • Proficient with Linux fundamentals.

Ways to stand out from the crowd:

  • Familiarity with resource scheduling managers, preferably Slurm.

  • Direct experience with industry standard alerting tools and emergency response practices.

  • Hands-on experience with GPU-focused hardware and software, such as DGX systems and Compute Clusters.

  • Proficiency in crafting and implementing a robust metrics collection and alerting infrastructure.

  • Proficiency in designing large scale networking technologies and the associated challenges.

The base salary range is 148,000 USD - 287,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.