Senior Hardware Diagnostics Engineer (AI Infrastructure)

Location: On-site in Las Vegas, Nevada, United States. Employment eligibility requires authorization to work in the United States.

Company

TensorWave provides a cloud platform for secure, reliable, resilient AI compute at scale across large infrastructure environments.

What you will do

• Own the firmware lifecycle across BIOS, BMC, NIC, GPU, and storage controllers, including qualification, approved baselines, staged rollouts, and rollback.
• Design validation harnesses for firmware releases, including regression testing and performance comparisons.
• Build fleet-scale automation with Redfish, IPMI, vendor management APIs, and internal systems.
• Define burn-in test matrices, thresholds, and evidence requirements, while controlling blast radius through pre-flight validation and staged deployment waves.
• Lead root cause analysis for hardware and firmware failures using PCIe analysis, sensor and event-log forensics, and thermal and power telemetry.
• Manage vendor escalations, prepare AMD platform bring-up and validation, mentor the diagnostics engineer, and contribute to incident response, runbooks, and documentation.

Requirements

• 6+ years of experience in infrastructure engineering, hardware validation, systems engineering, or a closely related field.
• Hands-on experience with BMCs and out-of-band management, including scripted interaction with Redfish, IPMI, iDRAC, iLO, or equivalent systems.
• Direct experience flashing, qualifying, and troubleshooting BIOS, BMC, and device firmware on enterprise servers.
• Strong Linux systems skills covering the boot process, kernel and driver behavior, and diagnostics with dmesg, lspci, ipmitool, SMART, and vendor CLIs.
• Ability to interpret PCIe topology and error output, SEL and sensor data, and thermal and power telemetry.
• Python experience for automation against REST APIs, including Redfish, vendor tooling, and internal systems.
• Rigorous diagnostic methodology involving hypothesis formation, falsifiable testing, variable isolation, and evidence-based documentation.
• Experience driving hardware issues with vendors through resolution and writing runbooks, RCAs, and vendor escalations.

Nice to have

• AMD GPU and ROCm experience, including amd-smi, rocm-smi, and ROCm Validation Suite.
• GPU and HPC validation at scale, including stress testing, RCCL or NCCL collective communication testing, and node health frameworks.
• Low-level bus and firmware experience with I2C, SMBus, BMC firmware behavior, or Redfish schema extensions.
• Kernel-level debugging, including crash dump analysis.
• Ansible, Git-based workflows, and CI/CD experience.
• NetBox or other DCIM and IPAM tooling used as a source of truth.
• Previous OEM, ODM, or hyperscaler experience with hardware bring-up or validation.

Culture & Benefits

• Stock options.
• 100% paid medical, dental, and vision insurance for employees.
• Health Savings Account contributions, Flexible Spending Account, and various supplemental health benefits.
• 100% paid short-term and long-term disability insurance, life insurance options, and other insurance options including pet and legal insurance.
• Flexible PTO, paid holidays, parental leave, an Employee Assistance Program, and in-office perks.
• Inclusive workplace with reasonable accommodations and equal employment opportunities.

Hiring process

• Offers are contingent on identity and United States work-authorization verification.
• Employment may be contingent on a job-related background check where permitted by law.