Data Engineer (Databricks)

TL;DR

Data Engineer (Databricks/Python): Designing, building, and maintaining Databricks-based data pipelines and lakehouse capabilities for the Department of War with an accent on secure data integration, analytics, and AI/ML workloads. Focus on building automated ETL/ELT pipelines, optimizing Spark workloads, and implementing medallion architecture for national defense missions.

Location: Arlington, VA. Must be a U.S. Citizen with an active DoW Secret (or higher) clearance.

Company

A forward-thinking technology partner for the government specializing in mission-critical modernization and impactful technology delivery.

What you will do

• Design, develop, and maintain Databricks-based data pipelines, data products, and lakehouse capabilities.
• Build automated ETL/ELT pipelines to ingest, transform, and deliver mission-critical data at enterprise scale.
• Develop production-grade data-processing solutions using Python, SQL, PySpark, Apache Spark, and Delta Lake.
• Design and maintain data models, schemas, and medallion architecture patterns supporting analytical and AI/ML workloads.
• Optimize Spark workloads and Databricks compute resources for performance, scalability, and cost efficiency.
• Collaborate with cybersecurity teams to implement data protection, access control, and governance using Unity Catalog.

Requirements

• U.S. Citizenship and active DoW Secret (or higher) clearance are mandatory.
• 4+ years of relevant data engineering or software engineering experience.
• Hands-on proficiency with Databricks, Python, SQL, PySpark, Apache Spark, and Delta Lake.
• Experience building automated ETL/ELT pipelines for large-scale datasets.
• Experience working with cloud-based data services in AWS, Azure, or Google Cloud.
• Bachelor’s degree in Computer Science, Engineering, or a related technical field preferred.

Nice to have

• Databricks certification or equivalent platform expertise.
• Experience supporting DoW, federal, Advana, or other enterprise data environments.
• Experience with CI/CD, infrastructure as code (IaC), and source control.
• Proficiency with streaming pipelines (Kafka, Kinesis, Pulsar) or orchestration tools (Airflow, Dagster, Argo).
• Approved certifications such as Cloud+, GSEC, Security+, or SSCP.

Culture & Benefits

• Flexible PTO and all Federal holidays off.
• Comprehensive health, dental, and vision insurance plans.
• 401k with employer match and Flexible Spending Account (FSA).
• Investment in professional development through training, certifications, and conferences.
• HQ office perks including parking/metro reimbursement and provided lunches.
• Unique perks such as access to Washington Capitals & Nationals tickets.