Software Engineer – Query Engines (Apache Spark)

Location: New York, NY; hybrid workplace

Salary: $135,000–$200,000 per year, excluding potential bonuses, benefits, and long-term incentives.

Company

hirify.global builds software platforms for data-driven decisions and operations, including infrastructure supporting hirify.global Foundry.

What you will do

• Design and implement query planning and optimization capabilities that convert complex computations into efficient execution plans.
• Extend data execution engines with improved operators, parallelism, memory management, and data movement.
• Develop Foundry integrations with Apache Iceberg, including table metadata, transactions, and efficient reads and writes.
• Build shared transformation semantics and execution interfaces for Foundry workloads and platform services.
• Improve incremental processing, open-source data system integrations, testing, benchmarking, and regression prevention.
• Investigate correctness and performance issues and collaborate with product teams and customers on engine capabilities.

Requirements

• 4+ years of professional software engineering experience building and operating production systems.
• Background in Computer Science, Mathematics, Software Engineering, Physics, or a similar field, or equivalent practical experience.
• Strong coding skills in one or more of Java, Rust, Scala, or C++.
• Experience with database engines, distributed data processing systems, storage systems, query planning, execution, or performance optimization.
• Strong foundations in algorithms, data structures, and concurrency, including diagnosing correctness and performance issues.
• Strong written and verbal communication skills and the ability to collaborate across teams.

Nice to have

• Experience building or extending Apache Spark, Apache DataFusion, Apache Iceberg, or comparable technologies.
• Experience contributing to open-source projects.

Culture & Benefits

• Medical, dental, vision, life, AD&D, and disability insurance options.
• Commuter benefits and a 401(k) plan.
• Take-what-you-need paid time off, year-end paid time off, and 10 paid holidays.
• Paid parental leave, family-building benefits, fertility support, and subsidized backup care.
• Relocation assistance and a supportive leave-of-absence program.
• In-person collaboration is encouraged, with hybrid options available for many teams.

Hiring process

• The application and hiring process provides reasonable accommodations for candidates with disabilities.