Senior Databricks Data Engineer

Location: Reston, Virginia, United States

Salary: $170,000–$210,000 per year

Company

hirify.global, through KIBO, provides inspection, analysis, certification, and compliance services to governments worldwide.

What you will do

• Lead the design, development, and optimization of data platforms and pipelines in a Databricks-on-AWS environment.
• Configure and manage Databricks workspaces and supporting AWS infrastructure.
• Build scalable batch and streaming pipelines using PySpark, Spark SQL, Delta Lake, and Auto Loader.
• Implement Medallion Architecture, analytics-ready data models, and integrations with APIs, file transfers, and operational systems.
• Configure Unity Catalog, permissions, row-level security, column masking, and data-access controls.
• Establish Git-based workflows, automated testing, CI/CD deployments, and data-quality monitoring in collaboration with data, AI, analytics, and engineering stakeholders.

Requirements

• 5+ years of Data Engineering experience, including 2+ years of hands-on production Databricks experience.
• Strong experience with the Databricks Lakehouse Platform, Delta Lake, Unity Catalog, and PySpark.
• Advanced SQL and Python development skills.
• Experience with Medallion Architecture and data models for analytics and reporting.
• Experience with Delta Live Tables, change data capture, incremental processing, and data-quality controls.
• Working knowledge of AWS services including S3, IAM, storage credentials, and external locations.
• Experience with Git, CI/CD pipelines, and automated testing practices.
• Bachelor’s degree in Computer Science, Information Systems, Engineering, or equivalent experience.

Nice to have

• Databricks Certified Data Engineer Associate or Professional certification.
• Experience with Spark performance tuning, cost optimization, API development, and local PySpark, Delta Lake, and pytest development.
• Experience supporting AI/ML, financial, trade, customs, or other regulated-data environments.

Culture & Benefits

• Competitive compensation and comprehensive benefits.
• Opportunity to build a modern Databricks data platform from the ground up.
• Exposure to data engineering and AI initiatives with significant ownership and impact.
• Collaborative, mission-driven working environment.