Senior Data Engineer / Databricks Engineer

Location: Hybrid at the Air National Guard Readiness Center, Joint Base Andrews, Maryland, with up to 3 telework days per week; remote work may be authorized only by the Government on an exception basis. Occasional travel may be required.

Salary: $125,000–$178,000 annually.

Company

hirify.global is a government contractor supporting Department of Defense customers and the Air National Guard Chief Data and Artificial Intelligence Office.

What you will do

• Design, build, test, deploy, and maintain automated and manual ETL/ELT pipelines for approximately 15–20 DAF, ANG, and DoD source systems.
• Implement structured, unstructured, API, batch, and streaming data ingestion, including near-real-time data requirements.
• Develop SQL and Python transformations for cleansing, standardization, deduplication, validation, and enrichment.
• Build and operate Azure Databricks jobs, orchestration sequences, triggers, and workload schedules while optimizing performance and cloud-compute utilization.
• Implement data-quality checks, reconciliation, quarantine, monitoring, logging, alerting, and recoverable error handling.
• Triage pipeline failures, perform root-cause analysis, restore service, maintain CI/CD assets, and create data lineage, mappings, architecture documentation, and runbooks.

Requirements

• Hands-on experience developing production-grade ETL/ELT pipelines with Azure Databricks or comparable Spark-based platforms.
• Advanced SQL and Python skills for transformation, validation, automation, troubleshooting, and performance optimization.
• Experience with batch and streaming ingestion, APIs, schema management, orchestration, monitoring, data quality, and failure recovery.
• Experience with Git-based version control and CI/CD practices for data-engineering solutions.
• Knowledge of data warehousing and lakehouse patterns, query optimization, access control, encryption, and secure handling of sensitive and CUI data.
• Active SECRET security clearance and compliance with applicable DoD/DAF security, cybersecurity-awareness, CUI, OPSEC, and access-training requirements.

Nice to have

• Experience with DAF/DoD systems such as MILPDS, DCPDS, AFRISS, CHRIS, CMS, CRIS, GFEBS, DEAMS, REMIS, AROWS, M4S, iEMS, or Lockheed Martin Tableau.
• Experience integrating Databricks with Palantir Foundry, Microsoft Azure, Advana/WDP, Power BI, or AskSage.

Culture & Benefits

• Medical, dental, and vision insurance.
• Life and disability insurance, 401(k) with employer match, paid holidays, PTO, and commuter benefits.
• Employee assistance program, educational reimbursement, and pet insurance.
• Work supporting enterprise data, business intelligence, application, and AI capabilities for data-driven mission decisions.