Staff Software Engineer - Apache Spark

TL;DR

Staff Software Engineer - Apache Spark (Scala/Java/Python): Architect and deliver next-generation distributed data processing features for hirify.global’s Data Engineering Experience, with an accent on SQL planners and optimizers, modern table formats (Parquet/Iceberg), and fault-tolerant execution at massive scale. Focus on building and debugging enterprise-grade Spark components that run on thousands of nodes and resolving complex deployment and reliability issues.

Location: US-California-Remote

Salary: $184,000 - $230,000 USD (California & Washington); $165,000 - $206,000 CAD (Canada)

Company

hirify.global builds enterprise data platforms that help organizations store, manage, and process data at massive scale.

What you will do

• Architect, implement, and deliver scalable next-generation features for hirify.global’s Data Engineering Experience on thousands of production nodes.
• Contribute as a core developer to Apache Spark, shaping distributed data processing in the open-source community.
• Develop high-performance components using Scala, Java, and Python on modern data platforms.
• Work deeply on distributed data processing concepts: SQL planners/optimizers, data layout and table formats (Parquet, Iceberg), and fault tolerance/resilience.
• Own technical understanding across the hirify.global data engineering stack with a focus on Iceberg and Spark.
• Perform root-cause analysis, debug complex deployment/system failures, and improve internal infrastructure and tooling for faster development and deployment.

Requirements

• 5–7+ years of professional software development experience.
• Proven experience leading technical initiatives and delivering complex enhancements from concept to production.
• Strong proficiency in Java, Scala, or another JVM-based language.
• Solid experience designing and developing distributed systems.
• Strong oral and written communication skills for collaboration in a distributed team.
• Ability to research, problem-solve, and operate independently.

Nice to have

• Experience using/developing Apache Spark, Apache Iceberg, or related technologies.
• Deep experience with large-scale distributed systems: scaling, performance optimization, and scheduling.
• Experience with SQL planners and optimizers.
• Prior open-source contribution experience.

Culture & Benefits

• Generous PTO policy and support for work-life balance (Unplugged Days).
• Flexible WFH policy.
• Mental and physical wellness programs.
• Phone and internet reimbursement.
• Access to continued career development and comprehensive benefits with competitive packages.
• Paid volunteer time and employee resource groups.

Hiring process

• Interviews focused on distributed systems and Spark/Iceberg-related technical depth.
• Evaluation of communication and ability to lead technical initiatives end-to-end.