Senior Data Engineer (Databricks)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
Senior Data Engineer (Databricks): Leading the design and evolution of Databricks-based data pipelines and lakehouse capabilities for mission-critical government systems with an accent on secure data integration, analytics, and AI/ML workloads. Focus on architecting scalable ETL/ELT pipelines, defining engineering standards, and ensuring platform reliability and governance at enterprise scale.
Location: Must be based in Arlington, VA. Candidates must be U.S. Citizens with an active DoW Secret (or higher) clearance.
Company
is a forward-thinking technology firm focused on delivering impactful, mission-critical solutions for government clients.
What you will do
- Lead the architecture and evolution of Databricks-based data pipelines and lakehouse capabilities.
- Translate mission requirements into scalable data architectures and implementation strategies.
- Define data engineering standards, reusable patterns, and best practices across engineering teams.
- Architect automated ETL/ELT pipelines using Python, SQL, PySpark, Apache Spark, and Delta Lake.
- Establish data quality, lineage, metadata, observability, and governance practices using Unity Catalog.
- Partner with cybersecurity teams to incorporate security, access control, and auditing requirements.
Requirements
- 9+ years of relevant data or software engineering experience.
- U.S. Citizenship and active DoW Secret (or higher) clearance required.
- Advanced proficiency with Python, SQL, PySpark, Apache Spark, and Delta Lake.
- Experience leading enterprise-scale data platform and pipeline implementations using Databricks.
- Experience architecting large-scale ETL/ELT, batch, and streaming pipelines.
- Strong understanding of data security, privacy, governance, and access-control principles.
Nice to have
- Relevant Databricks certification.
- Experience supporting DoW, federal, or Advana mission data environments.
- Experience with Terraform, Databricks Asset Bundles, or Airflow.
- Experience supporting AI/ML pipelines or MLflow.
- Relevant security certifications such as Cloud+, GSEC, Security+, or SSCP.
Culture & Benefits
- Flexible PTO and all Federal holidays off.
- Comprehensive health, dental, and vision insurance plans.
- 401k with employer match.
- Professional development budget for training, certifications, and conferences.
- Access to company-sponsored social events and sports tickets.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →