1 день назад
Senior Data Engineer (Databricks)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (Databricks): Designing, building, and operating enterprise-grade data platforms and scalable batch and streaming pipelines for large-scale healthcare modernization and analytics initiatives with an accent on DataOps, data quality, security, and regulatory compliance. Focus on developing Databricks Lakehouse medallion architectures, optimizing cloud data processing, implementing observability and CI/CD, and supporting CMS and federal healthcare data programs.
Location: Washington, DC, United States
Company
is a consulting and information technology solutions provider supporting public-sector health, civilian, and national security missions.
What you will do
- Design, build, maintain, and optimize scalable batch and streaming data pipelines using Databricks and cloud-native services.
- Develop ETL/ELT workflows and Databricks Lakehouse medallion architectures for reporting, analytics, machine learning, and data sharing.
- Establish DataOps processes covering pipeline monitoring, automated testing, deployment, version control, CI/CD, alerting, and incident response.
- Implement data integration, auditability, lineage, metadata management, and data quality controls across structured and unstructured healthcare data.
- Collaborate with architects, data scientists, analysts, security teams, and stakeholders on platform strategy, architecture decisions, and implementation roadmaps.
- Lead technical design reviews, optimize cloud performance and costs, troubleshoot production issues, and mentor junior engineers.
Requirements
- Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related technical discipline.
- 8+ years of data engineering experience, including enterprise-scale data environments, and 3+ years supporting CMS or other federal healthcare programs.
- Expert-level Databricks Lakehouse experience with strong proficiency in Apache Spark, PySpark, SQL, and Python.
- Experience with AWS or Azure cloud data platforms, enterprise data pipelines, orchestration tools, and Git-based CI/CD workflows.
- Knowledge of data quality, observability, lineage, metadata management, monitoring, lakehouse, warehouse, and modern data architecture patterns.
- Experience operating production data platforms in regulated healthcare environments and supporting CMS, Medicare, Medicaid, PHI, PII, and federal security and compliance requirements.
Nice to have
- Databricks Data Engineer Professional or additional Databricks certifications.
- Experience with Delta Lake, Unity Catalog, Collibra, Informatica, or comparable governance platforms.
- Experience with MLOps, AI/ML data pipelines, FedRAMP, or FISMA-compliant environments.
- Prior experience leading technical teams or serving as a technical lead.
Culture & Benefits
- Work supporting public-sector health, civilian, and national security missions.
- Competitive compensation with bonus opportunities.
- Employer-paid healthcare.
- Training and development funds.
- 401(k) match.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
7 дней назад
Senior Analytics Engineer (Databricks/Azure)
140 000 - 175 000$
2 дня назад
Senior Data Engineer (Azure)
133 000 - 150 000$
6 дней назад
Data Engineers (Databricks / PySpark)
21 час назад
Senior Data Engineer
155 000 - 175 000$
3 дня назад
Senior Data Engineer (Databricks)
20 часов назад