Staff Designated Support Engineer (Apache Spark)

TL;DR

Staff Designated Support Engineer (Apache Spark): Delivering high-touch specialized support and tailored technical solutions for strategic customers with an accent on troubleshooting complex product issues in Spark, SQL, and Delta. Focus on root cause analysis of performance and reliability issues, building rapid POCs, and optimizing DNB customer environments.

Location: Japan

Salary: $102,400 — $181,200 USD

Company

hirify.global is a data and AI company providing a Data Intelligence Platform to unify data, analytics, and AI for over 10,000 organizations worldwide.

What you will do

• Perform advanced troubleshooting and root cause analysis for Spark, SQL, Delta, and Streaming features.
• Build rapid POCs and deploy solutions to showcase Spark, ML, and AI runtime capabilities.
• Develop comprehensive playbooks and maintain a knowledge base for AI/ML workflows.
• Train customer engineering and business teams on performance tuning and debugging best practices.
• Collaborate onsite with Field Engineering, Sales, and Product teams to resolve production-impacting issues.
• Act as a trusted technical advisor and primary point of contact for the largest strategic customers.

Requirements

• Location: Must be based in Japan
• 8–12 years of experience designing and troubleshooting distributed computing applications.
• 4+ years delivering production-scale Spark/ML/AI solutions using Python, Java, or Scala.
• Hands-on expertise with Data Lakes, SQL-based databases, and Cloud Data Warehousing (e.g., Snowflake, Redshift, BigQuery).
• Deep knowledge of Spark core internals, JVM optimization, and memory management.
• Practical experience with AWS, Azure, or GCP and building CI/CD pipelines.
• 3–5 years in customer-facing roles such as Technical Account Manager or Solutions Architect.

Nice to have

• Proficiency in AI ecosystems, including Machine Learning, Deep Learning, and Generative AI.

Culture & Benefits

• Comprehensive benefits and perks tailored to the local region.
• Inclusive culture committed to diversity and equal employment opportunity standards.
• Eligibility for annual performance bonuses and equity.
• Opportunity to work with the original creators of Lakehouse, Apache Spark, Delta Lake, and MLflow.