Azure Databricks Administrator (Azure Databricks)

Company

hirify.global is an integrated academic health system providing medical services, education, research, and patient care across New York and Florida.

What you will do

• Manage Azure Databricks workspaces, clusters, jobs, runtimes, libraries, policies, and user access.
• Administer Unity Catalog, Azure Blob Storage, Data Lake Storage, Key Vault, networking, firewalls, and Azure policies.
• Configure Azure Data Factory for data integration and ETL workflows.
• Implement Azure DevOps CI/CD pipelines, automated deployments, version control, and administrative automation.
• Monitor platform health, performance, usage, budgets, alerts, and operational costs.
• Collaborate with data engineers, data scientists, analysts, and stakeholders to troubleshoot issues and optimize data workflows.

Requirements

• Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field.
• 7+ years of professional experience administering data platforms, including 3+ years with Azure Databricks Lakehouse Platform.
• Proficiency in Python/PySpark, PowerShell, or Bash, with experience automating administrative tasks and workflows.
• Experience with ETL processes, data pipelines, big data technologies, backup and restore procedures, and troubleshooting.
• Knowledge of security best practices, compliance requirements, documentation, and disaster recovery concepts.
• Strong written and verbal communication skills and the ability to support cross-functional internal and external users.

Nice to have

• Deep knowledge of Databricks architecture, Delta Lake, Databricks SQL, and performance tuning.
• Experience supporting data science and machine learning workloads on Databricks.
• Experience integrating Databricks with other data platforms and tools.
• Understanding of hybrid and multi-cloud environments and regulatory data protection requirements.

Culture & Benefits

• Comprehensive health, wellness, financial security, and retirement support.
• Generous time-off program and employee resource groups.
• Holistic wellness resources covering physical, mental, nutritional, sleep, social, financial, and preventive care.
• Inclusive equal-opportunity employment environment.