Senior Databricks Platform Engineer (Remote US) (Azure Databricks)

Location: Remote within the United States; candidates must reside in the U.S., be authorized to work in the U.S., and perform all work in the U.S.

Salary: $98,614–$202,850 per year

Company

hirify.global is an advisory and technology services provider delivering technology solutions for complex client and government challenges.

What you will do

• Design, configure, secure, and operate Azure Databricks workspaces, clusters, jobs, workflows, catalogs, credentials, and service principals.
• Build and optimize batch and real-time ingestion and transformation pipelines using Python, PySpark, SQL, Scala, Delta Lake, Delta Live Tables, Auto Loader, and Apache Spark.
• Implement medallion architecture, dimensional models, change data capture, schema evolution, data quality controls, and reliable retry and rollback patterns.
• Implement Unity Catalog governance, lineage, role-based access, retention, and secure integrations with ADLS Gen2 and other storage services.
• Automate deployments and environment configuration with Terraform, Databricks Asset Bundles, GitHub Actions, Azure DevOps, or comparable tools.
• Monitor platform health, troubleshoot performance and data issues, and support security, ATO, vulnerability remediation, business continuity, disaster recovery, and operational readiness.

Requirements

• More than 5 years of data engineering experience, including at least 3 years supporting Azure Databricks and related Azure data services.
• Expertise in Apache Spark, Delta Lake, Python, SQL, Scala, and large-scale ETL/ELT pipeline design and optimization.
• Experience with Azure Data Factory, Azure Data Lake Storage, Azure Synapse Analytics, Databricks workflows, data modeling, governance, security, and cost optimization.
• Experience with CI/CD or infrastructure as code using Git and tools such as Terraform, Databricks Asset Bundles, GitHub Actions, or Azure DevOps.
• U.S. citizenship, U.S. residence, U.S. work authorization, and the ability to satisfy FDIC personnel eligibility and background-investigation requirements are required.
• Ability to communicate architecture, risks, operational impacts, and technical decisions to technical and business stakeholders.

Nice to have

• Experience with Unity Catalog, Delta Live Tables, Auto Loader, streaming data, Kafka, Structured Streaming, Apache Iceberg, Snowflake, or enterprise data platforms.
• Experience supporting generative AI, NLP, RAG applications, vector stores, agents, MLflow, or cross-cloud AI architectures.
• Experience with BCDR, high availability, disaster recovery, federal compliance controls, ATO processes, NIST, Zero Trust, or vulnerability remediation.
• Experience with Docker, Kubernetes, REST APIs, FastAPI, Node.js, or cloud-native application integration.

Culture & Benefits

• Full-time remote work within the United States.
• Work in Agile delivery with data engineering, AI, cloud, security, application, and operations teams.
• Participate in code reviews, demos, retrospectives, architecture documentation, and version-controlled delivery.
• Reasonable accommodations are available throughout the application and employment process.

Hiring process

• Applications must be submitted directly by the applicant.
• Interview responses must reflect the candidate’s own skills and knowledge; AI assistance is not permitted during interviews except where required as an accommodation.