Azure Databricks Data Engineer (AI)

Location: California, United States

Salary: $120,000–$140,000 per year, plus a potential discretionary bonus.

Company

hirify.global is a strategic AI partner delivering data and analytics solutions for Fortune 500 enterprises.

What you will do

• Design, build, and optimize scalable data pipelines and ETL/ELT workflows with Azure Databricks.
• Implement batch and real-time processing for structured and unstructured data using PySpark and Spark SQL.
• Develop data ingestion frameworks and enterprise data lakes with Azure Data Lake Storage Gen2.
• Integrate cloud and on-premises data sources and support dimensional modeling and data warehouse initiatives.
• Implement data quality, validation, monitoring, security, governance, and compliance frameworks.
• Automate deployments with CI/CD and contribute to architecture discussions while providing technical leadership to junior engineers.

Requirements

• 6–10 years of experience in data engineering and analytics.
• At least 3 years of hands-on experience with Azure Databricks.
• Strong experience with PySpark, SQL, cloud-native data platforms, enterprise-scale data lakes, and data warehouses.
• Knowledge of Spark performance tuning and optimization techniques.
• Experience working in Agile delivery environments.
• Bachelor’s or master’s degree in computer science, information technology, engineering, or a related field.

Nice to have

• Azure Data Engineer Associate certification (DP-203).
• Experience with Unity Catalog, Databricks Workflows, or Delta Live Tables.
• Experience supporting AI/ML workloads and data science teams.
• Exposure to Snowflake, Power BI, or Microsoft Fabric.
• Scala, Terraform, or healthcare, life sciences, and pharmaceutical domain experience.

Culture & Benefits

• Full-time employment with health, dental, vision, life insurance, and disability plans.
• Benefits eligibility begins on the first day of employment.
• 401(k) eligibility begins after 30 days.
• 11 paid holidays, 12 weeks of parental leave, and a flexible “free time” PTO policy.
• Visa sponsorship is not available.