Principal Data Engineer (Databricks & AI Platform)

Location: Bangalore, Karnataka, India

Company

hirify.global builds remote work technology and flexible workplace solutions, using AI to deliver practical value for customers and teams.

What you will do

• Own the architecture and multi-year roadmap for the Databricks data platform, including Unity Catalog, Delta Lake, cluster configuration, and workflow orchestration.
• Design scalable medallion lakehouse architectures, data pipelines, and AI-ready datasets for GenAI and ML use cases.
• Set and enforce standards for data quality, security, access control, infrastructure as code, and CI/CD.
• Tune Spark jobs and clusters for performance and cost, and build reusable ETL frameworks and platform components.
• Lead migrations from legacy data platforms to Databricks, including data modeling and pipeline redesign.
• Mentor senior engineers, troubleshoot production issues, and drive adoption of spec-driven development and agentic AI tooling.

Requirements

• 12+ years of data engineering experience, including 3+ years of hands-on production experience with Databricks.
• Deep expertise in Unity Catalog, Delta Lake, Spark performance tuning, and medallion or lakehouse architectures.
• Strong SQL and Python skills.
• Experience with AWS, Azure, or GCP, infrastructure-as-code tooling, and CI/CD for data pipelines, including Databricks Asset Bundles.
• Experience leading technical decisions, mentoring engineers, and communicating across engineering, analytics, and business stakeholders.
• Experience rolling out AI agents or AI-assisted tooling across an engineering team.

Nice to have

• Experience with Airflow or dbt.
• Experience with Kafka or other streaming and messaging systems.
• Exposure to GenAI, RAG, or LLM-based data applications.
• Experience leading a legacy data warehouse migration to Databricks.

Culture & Benefits

• Comprehensive health benefits and generous paid time off.
• Paid holidays, volunteer days, quarterly self-care days, and company-designated no-meeting days.
• Tuition reimbursement and instructor-led and on-demand learning programs.
• Wellness support through the Thrive Global Wellness Program, EAP, wellness app, and coaching.
• Employee Resource Groups, employee-led communities, charitable matching, and an inclusive workplace.