Senior Systems Engineer (Codex, Distributed Systems)

About the team

Maintain and repair the latest GPUs for OCI's growing GPU fleet. Monitor fleet health, improve observability, and continuously build/enhance automation and tooling to ensure maximum customer availability.

Description

We are seeking a Senior Systems Engineer to join the AI Infra Operations team supporting GPU infrastructure in Oracle Cloud Infrastructure (OCI). In this role, you will assist in the development and maintenance of automation and operational tooling for GPU fleets across multiple regions, ensuring high availability. You will collaborate  with engineering and operations teams to build robust automation, observability, and reliability solutions while continuously working on and improving GPU operations.

Responsibilities

• Independently troubleshoot and resolve production issues involving Linux hosts, GPU systems, and host-network interactions.
• Support GPU host operations across provisioning, validation, incident response, and operational readiness activities.
• Own incident response and resolution for assigned services while escalating appropriately when problems cross team or domain boundaries.
• Identify recurring failure patterns and contribute improvements to runbooks, tooling, monitoring, and operational procedures.
• Work with partner teams to resolve issues that span hardware, operating systems, networking, and service dependencies.
• Contribute automation and scripting improvements that reduce manual effort and improve operator effectiveness.
• Participate in on-call rotations and provide support for critical infrastructure issues.
• Provide data-driven analysis to address problems instead of symptoms.

Required Qualifications:

• 5+ years of software operations, systems administration or infrastructure automation experience with proficiency in Python and Bash.
• Strong Linux administration experience.
• Good understanding of host-level networking fundamentals, including TCP/IP, routing, DNS, interface behavior, and connectivity troubleshooting.
• Understanding of peer-to-peer, node-to-node, and service-to-service communication patterns in distributed systems.
• Experience supporting data center operations or large-scale infrastructure environments.
• Demonstrated troubleshooting experience across GPU hosts, operating systems, hardware, networking, drivers, and dependent services in production.
• Automation experience using shell scripting and operational tooling to reduce manual effort and improve reliability.
• Strong operational ownership, incident handling, and problem-solving skills in production environments.
• Hands-on experience with monitoring, deployment, configuration, and support tooling used in day-to-day operations.

Preferred Skills:

• Hands-on experience with GPU infrastructure, including NVIDIA and AMD based systems, and familiarity with GPU shapes or instance families.

Qualifications

8 years of experience in computer network administration, database management, systems architecture, systems administration, or related field

OR

Bachelor's Degree in information technology, computer science, engineering or related field AND 4 years experience in computer network administration, database management, systems architecture, systems administration, or related field

OR

Master’s Degree in information technology, computer science, engineering or related field AND 2 year experience in computer network administration, database management, systems architecture, systems administration, or related field.

Same skills at prior level plus;

Operating Systems Demonstrated ability in or knowledge of operating systems, including installing, upgrading, and troubleshooting various operating environments.

Performance Tuning Demonstrated ability in or knowledge of performance tuning, including optimizing system or application performance and using relevant tools and techniques.

Systems Integration Demonstrated ability in or knowledge of systems integration, including describing, supporting, or overseeing technology integration projects.

Technical Writing Demonstrated ability in or knowledge of technical writing, including developing and maintaining accurate technical documentation.

Troubleshooting Demonstrated ability in or knowledge of troubleshooting, including diagnosing and resolving issues across various technical domains.

Cloud Computing Demonstrated ability in or knowledge of cloud computing, including deploying, managing, and securing cloud environments and applications.

Scripting Languages Demonstrated ability in or knowledge of scripting languages, including writing and maintaining scripts to improve system efficiency.

9 years of experience in computer network administration, database management, systems architecture, systems administration, or related field

OR

Bachelor's Degree in information technology, computer science, engineering or related field AND 5 years of experience in computer network administration, database management, systems architecture, systems administration, or related field

OR

Master’s Degree in information technology, computer science, engineering or related field AND 3 years of experience in computer network administration, database management, systems architecture, systems administration, or related field.

Oracle Product Knowledge Demonstrated knowledge of Oracle products and the ability to educate customers on their effective use.