Staff AI Observability & Telemetry Engineer (AI)

TL;DR

Staff AI Observability & Telemetry Engineer (AI/SRE): Architecting and scaling high-cardinality telemetry infrastructure for AI cloud and Bitcoin mining with an accent on high-performance time-series databases and Kubernetes observability. Focus on building eBPF-based diagnostic tools, integrating hardware-level exporters, and designing multi-tenant billing pipelines based on real-time GPU utilization.

Location: Singapore, SG

Company

hirify.global is a world-leading technology company providing comprehensive Bitcoin mining solutions and high-performance AI cloud capabilities globally.

What you will do

• Architect and scale high-cardinality telemetry infrastructure using VictoriaMetrics, Thanos, or Mimir.
• Integrate hardware-level exporters (NVIDIA DCGM, IPMI/Redfish) into the Kubernetes observability stack.
• Build eBPF-based diagnostic tools to trace network congestion and kernel-level I/O latency.
• Develop automated dashboards and alerting pipelines to proactively manage degraded hardware.
• Design real-time GPU and network utilization metric pipelines for multi-tenant consumption billing.
• Lead technical design reviews and mentor team members on high-performance telemetry standards.

Requirements

• 6+ years of software or SRE experience with deep expertise in the Prometheus/OpenTelemetry ecosystem.
• Advanced proficiency in Go and experience writing custom Kubernetes metric exporters and operators.
• Hands-on experience with kernel-level tracing tools (eBPF, BCC) and Linux performance tuning.
• Familiarity with AI hardware metrics (GPU power states, SM utilization, memory bandwidth).
• Proven track record of scaling large-scale telemetry stacks in HPC or cloud environments.
• Strong technical leadership skills and ability to influence architectural decisions.

Culture & Benefits

• Inclusive environment with an exciting start-up spirit and diverse perspectives.
• Opportunity to network with industrial pioneers and directly impact the digital asset industry.
• High level of personal accountability, autonomy, and fast growth opportunities.
• Attractive welfare benefits, including professional training and mentoring.