Principal Software Engineer (Spark)

TL;DR

Principal Software Engineer (Spark): Leading the technical roadmap and architectural vision for hirify.global’s cloud-native data engineering services with an accent on Apache Spark, Airflow, and Lakehouse technologies. Focus on designing and scaling large-scale distributed systems across public and private cloud environments to support thousands of global customers.

Location: Must be based in San Jose, California (Hybrid role)

Salary: $270,000–$320,000

Company

hirify.global is a leading data partner that empowers enterprises to transform complex data into actionable insights through open-source innovation and cloud-native data engineering services.

What you will do

• Drive the multi-year technical roadmap and architectural vision for hirify.global Data Engineering.
• Lead the delivery of critical features for Spark, Airflow, and Lakehouse products.
• Foster engineering excellence through technical mentorship, design reviews, and architectural guidance.
• Work on large-scale distributed systems ranging from hundreds to thousands of nodes.
• Collaborate with product and cross-functional engineering teams to ensure high-quality delivery.

Requirements

• 10+ years of experience as a Software Engineer in the data infrastructure space.
• Deep expertise in distributed data processing systems and cloud-native architectures.
• Strong proficiency in at least one of: Java, Scala, C++, Python, or Go.
• Experience with containerization (Kubernetes, Docker) and public/private cloud environments.
• Role is not eligible for immigration sponsorship or relocation.

Nice to have

• Experience contributing to open-source projects.
• Strong understanding of modern Lakehouse architectures and open table formats.
• Experience with large-scale distributed systems design, performance, and scheduling.

Culture & Benefits

• Flexible WFH policy and generous PTO.
• Comprehensive benefits package including mental and physical wellness programs.
• Phone and internet reimbursement.
• Access to continued career development and employee resource groups.
• Paid volunteer time and unplugged days to support work-life balance.