Solutions Architect (Big Data)

TL;DR

Solutions Architect (Big Data): Designing and deploying scalable data engineering and AI solutions on the Databricks platform with an accent on Apache Spark optimization and cloud-native architecture. Focus on guiding strategic customers through complex migrations, building production-grade data pipelines, and ensuring successful adoption of the Databricks Data Intelligence Platform.

Location: Must be based in the US (Hybrid, 20% travel required).

Company

Databricks is the data and AI company, founded by the creators of Apache Spark, Delta Lake, and MLflow, helping organizations unify and democratize data, analytics, and AI.

What you will do

• Guide strategic customers through end-to-end design, build, and deployment of big data and AI applications.
• Consult on architecture and bootstrap customer projects to ensure successful platform adoption.
• Collaborate with engagement managers to scope professional services work and manage project timelines.
• Provide escalated technical support and operational guidance for customer issues.
• Facilitate technical workshops, discovery sessions, and requirements gathering for strategic accounts.
• Mentor team members and partners while developing reusable project artifacts and best practices.

Requirements

• Must be based in the US.
• 4+ to 9+ years of experience in data engineering, data platforms, and analytics.
• Deep expertise in distributed computing with Apache Spark and knowledge of runtime internals.
• Proficiency in Python or Scala for data engineering tasks.
• Working knowledge of at least two major cloud ecosystems (AWS, Azure, or GCP).
• Experience with CI/CD, MLOps, and managing technical project delivery.

Nice to have

• Databricks Certification.

Culture & Benefits

• Comprehensive benefits and perks tailored to regional needs.
• Commitment to a diverse and inclusive culture with equal employment opportunity standards.
• Opportunity to work with industry-leading data and AI technologies.
• Collaborative environment with global teams and Fortune 500 clients.