Data Management Specialist (Databricks)

Location: Washington, DC (onsite); US Citizenship required

Salary: $52.99 per hour on W2

Company

hirify.global provides outsourced services and workforce solutions across North America.

What you will do

• Lead the design, implementation, and optimization of Databricks solutions using Unity Catalog, Delta Lake, Databricks SQL, Workflows, Jobs, and Mosaic AI.
• Build and maintain scalable ingestion, transformation, and orchestration pipelines with Spark, Delta Live Tables, and Auto Loader.
• Tune Spark jobs, clusters, and SQL queries while implementing cost optimization, auto-scaling, and resource management.
• Establish security, governance, compliance, monitoring, logging, alerting, and dashboarding practices for Databricks workloads.
• Support data science and machine learning teams with MLflow, Feature Store, Vector Search, and generative AI capabilities.
• Mentor technical teams, resolve complex production issues, integrate Databricks with cloud and enterprise tools, and translate business requirements into data and AI solutions.

Requirements

• Bachelor’s degree in Information Technology, Computer Science, Business Administration, or a related field, or equivalent work experience.
• 7+ years of experience in Data Engineering or Architecture, including at least 4+ years dedicated exclusively to the Databricks ecosystem.
• Proven experience implementing Unity Catalog from scratch, including row- and column-level security and cross-workspace governance.
• Deep Apache Spark tuning expertise, including data skew, shuffles, Adaptive Query Execution, caching, and Photon optimization.
• Production experience building Generative AI or LLM applications with Databricks Mosaic AI, Vector Search, and MLflow.
• Advanced proficiency in Python, Scala, and SQL for distributed computing environments.
• Production experience with Terraform or similar Infrastructure as Code tools for Databricks workspaces, clusters, and permissions.
• Experience with secure Databricks network topologies, including Private Link/VPC Peering, BYOK encryption keys, and IP access lists.
• Strong CI/CD experience with GitHub Actions, Azure DevOps, or GitLab using Databricks Asset Bundles or Databricks CLI.

Nice to have

• Databricks Certified Solutions Architect certification.
• Databricks Certified Data Engineer Professional certification.
• Databricks Certified Machine Learning Professional certification.
• Cloud architecture certification such as AWS Certified Solutions Architect or Azure Solutions Architect Expert.

Culture & Benefits

• Contract position with onsite work in Washington, DC.
• W2 employment with eligible health and welfare benefits, including medical, dental, vision, spending accounts, life insurance, and voluntary plans.
• Eligible employees may participate in a 401(k) plan.