Staff Engineer in Test (Hadoop)

Location: On-site at the Pune office, India

Company

hirify.global develops enterprise data infrastructure and an ecosystem primarily focused on the Hadoop ecosystem.

What you will do

• Design system-level test strategies and validation plans for networking, security, and enterprise readiness features.
• Create scalable automated test suites for Hadoop components, covering multi-tenant behavior, concurrency, data consistency, and system performance.
• Build and maintain test automation, reusable harnesses, templates, and utilities using Docker, Jenkins, Kubernetes, and Hadoop benchmarks.
• Construct performance, stress, and reliability tests for I/O throughput, latency, NVMe access patterns, concurrency limits, and long-running workloads.
• Use profilers, fuzzers, failure-injection frameworks, and trace analyzers to identify issues and performance bottlenecks across distributed workflows.
• Collaborate with architects, developers, release engineering, DevOps, and customer engineering on testability, observability, resilience, root cause analysis, and quality standards.

Requirements

• 10+ years of experience in software quality engineering, with a strong focus on distributed systems, system-level testing, or infrastructure platforms.
• Hands-on test automation experience with Python, Bash, Git, Jenkins, and modern CI/CD tooling.
• Strong understanding of distributed concurrency, file systems, I/O behavior, storage performance analysis, NVMe, SPDK, networking, tracing, and system observability.
• Experience with large-scale performance testing, stress testing, reliability validation, and diagnosing issues through logs, traces, network captures, and profiling tools.
• Experience validating large-scale data platforms, storage engines, or distributed scheduling systems.
• Background in security or compliance testing, including access control, backup and restore workflows, Section 508, HIPAA, or PCI.

Nice to have

• Experience with Hadoop products.
• Experience applying AI technologies to issue triaging, test generation, and automation.
• Familiarity with OpenTelemetry, Grafana, and Prometheus.
• Contributions to open-source test frameworks or distributed systems validation tools.

Culture & Benefits

• Hands-on, high-impact individual contributor role within Global Engineering.
• Opportunity to improve quality engineering practices and platform stability across the organization.
• Cross-functional collaboration with architecture, development, release engineering, DevOps, and customer engineering groups.