Principal Software Engineer (Data Processing OSS)

Location: Remote within the United States; San Jose, California is also listed. The role may include in-office or in-person expectations during the recruitment process.

Salary: $227,800–$338,800 per year, plus a comprehensive benefits package.

Company

hirify.global develops intelligent data infrastructure, unified storage, integrated data services, and cloud-based solutions for enterprise workloads and AI.

What you will do

• Architect how the DataPelago data processing engine interfaces with open-source platforms and processing engines.
• Design functional and performance enhancements for Apache Gluten, Velox, and related platforms.
• Design, implement, test, optimize, and maintain core data processing engine components.
• Analyze open-source technology roadmaps and identify opportunities to improve product capabilities and leadership.
• Collaborate with engineering, product management, open-source communities, and customer success teams.
• Improve design reviews, code quality, testing, CI/CD, security, and issue resolution.

Requirements

• 15+ years of relevant experience and a bachelor's degree in computer science or a related field, or a master's degree in computer science or a related field.
• 3+ years of deep technical experience developing core components of large-scale data processing platforms such as Apache Spark, Apache Flink, Apache Doris, Apache Gluten, Velox, Apache DataFusion, or equivalent systems.
• 3+ years of experience instrumenting, analyzing, and optimizing data processing engine performance on benchmark and customer workloads.
• Strong knowledge of the architecture and internal operation of Apache Spark, Apache Flink, or Presto/Trino.
• Experience designing, developing, and releasing high-performance data processing engines for large production deployments.
• Exceptional programming skills in C, C++, and Java, with extensive Linux development experience.

Culture & Benefits

• Hybrid working environment with in-office and/or in-person expectations for most roles.
• Health insurance, life insurance, retirement or pension plans, paid time off, and various leave options.
• Performance-based incentives, employee stock purchase plans, and restricted stock units may be included.
• Flexible environment supporting professional and personal balance.