Principal Engineer (Observability)

TL;DR

Principal Engineer (Observability): Designing and building a multi-tenant, high-throughput telemetry fabric and self-service OpenTelemetry-based ecosystem for massive-scale data estates with an accent on high-cardinality logs, metrics, and traces. Focus on architecting seamless telemetry integration for distributed components, influencing OTel open-source standards, and enabling deep-dive workload analysis via OLAP engines like ClickHouse.

Location: USA, Austin, Texas (Hybrid). This role is not eligible for immigration sponsorship.

Company

hirify.global empowers enterprises to transform complex data into actionable insights using an open-source powered data platform.

What you will do

• Architect and implement automated "on-ramps" for observability clients in multi-cloud and hybrid environments.
• Establish semantic conventions to ensure correlation of telemetry data across the entire hirify.global stack.
• Develop high-performance SDKs and interfaces for Java, Go, and Python clients to contribute high-fidelity signals.
• Build logic to unify disparate signals into traces for workload analysis and financial governance across massive distributed systems.
• Lead technical decision-making, resolve systemic bottlenecks, and perform deep-dive code reviews.
• Represent hirify.global within the CNCF/OTel community to influence the direction of open-source observability.

Requirements

• 10+ years of experience designing large-scale distributed systems and observability platforms.
• Deep expertise with OpenTelemetry Collector architecture and handling high-cardinality data.
• Experience with high-volume OLAP engines such as ClickHouse or StarRocks.
• Proven track record of shipping foundational infrastructure used by other engineering teams.
• Ability to coach senior and staff-level engineers as a technical force multiplier.
• Must have valid US work authorization; this role is not eligible for immigration sponsorship.

Nice to have

• Significant contributions to CNCF or Apache projects, specifically as an OTel maintainer.
• Deep experience with Kubernetes-native observability in hybrid-cloud environments.
• Experience using machine learning or advanced analytics to derive AIOps insights from raw telemetry.

Culture & Benefits

• Flexible WFH policy and dedicated "Unplugged Days" to support work-life balance.
• Generous PTO policy and paid volunteer time.
• Comprehensive health, mental, and physical wellness programs.
• Phone and internet reimbursement program.
• Access to continued career development opportunities.