GPU DevOps / Infrastructure Setup Engineer

About the Company

About the Role

We are looking for experienced GPU DevOps / Infrastructure Setup Engineers to support the deployment, configuration, automation, and management of GPU-enabled infrastructure and workloads. The engineers will be responsible for setting up and maintaining GPU compute environments, configuring operating systems and supporting software, deploying workloads, automating infrastructure, and troubleshooting infrastructure and performance-related issues. The role requires strong hands-on experience in DevOps, Linux, cloud/infrastructure environments, containerization, automation, and GPU-based computing. Experience with any GPU platform or hardware vendor is acceptable.

Responsibilities

• Set up, configure, and maintain GPU-enabled compute infrastructure.
• Configure operating systems, system software, drivers, and supporting components required for GPU workloads.
• Provision and configure GPU servers, compute nodes, and related infrastructure.
• Deploy and manage GPU-based workloads across cloud, on-premise, or hybrid environments.
• Configure and manage containerized GPU workloads using Docker and/or Kubernetes.
• Automate infrastructure provisioning, configuration, and deployment processes.
• Develop and maintain CI/CD pipelines for infrastructure and application workloads.
• Monitor GPU infrastructure, resource utilization, system health, and performance.
• Troubleshoot infrastructure, GPU, operating system, networking, storage, and application deployment issues.
• Perform infrastructure upgrades, configuration changes, patching, and maintenance.
• Support scaling and provisioning of additional GPU compute resources as required.
• Implement monitoring, logging, alerting, and operational processes.
• Work with development, AI/ML, platform, and infrastructure teams to support GPU-based applications.
• Create and maintain technical documentation, setup guides, deployment procedures, and troubleshooting documentation.
• Follow infrastructure security, access-control, and operational best practices.

Qualifications

Required Skills

• 3+ years of experience in DevOps, SRE, or infrastructure engineering, with at least 1–2 years working on GPU environments.
• Candidates with strong hands-on experience in GPU infrastructure setup and operations will be preferred.