Principal Scala Engineer (Apache Spark)

TL;DR

Principal Scala Engineer (Apache Spark): Define technical vision and architecture for large-scale distributed data systems with an accent on Apache Spark ecosystem contributions, high-performance platform design, and best practices. Focus on leading Spark integrations, optimizing Dataset APIs, and influencing open source evolution.

Location: Remote (Global)

Company

hirify.global is a global technology company delivering cutting-edge solutions with a diverse team of top tech talent.

What you will do

• Contribute actively as a core contributor to Apache Spark and related open source projects.
• Define architecture and optimization strategies for enterprise-scale Spark platforms.
• Lead technical vision for Spark integrations and performance enhancements.
• Shape best practices for Scala and Spark development across teams.
• Influence Apache Spark’s evolution through open source contributions.

Requirements

• 10+ years of software development experience.
• Advanced English proficiency.
• Strong expertise in Scala, functional programming, and JVM optimization.
• Deep understanding of Spark internals including Catalyst and Tungsten.
• Proven leadership in large-scale distributed Spark projects.
• Core contributions to Apache Spark or related open source projects.

Culture & Benefits

• Excellent compensation in USD or local currency.
• Paid parental leave, vacation, and national holidays.
• Innovative and multicultural work environment.
• Collaboration with global top 1% tech talent.
• Supportive environment with mentorship, promotions, and skill development.