12 часов назад
Data Engineer (Databricks)
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Engineer (Databricks): Building scalable data pipelines, APIs, and reusable data products for mission-critical federal health and defense data with an accent on Spark, Python, SQL, and Databricks. Focus on integrating complex datasets, optimizing production workflows, and implementing data quality, lineage, and governance practices.
Location: Remote within the continental United States; periodic travel may be required.
Company
delivers technology and data modernization solutions for mission-critical government programs.
What you will do
- Design, develop, and maintain production-ready data pipelines using Spark, Python, SQL, and Databricks.
- Integrate and transform health, financial, and operational datasets into reusable data products.
- Develop data models and analytics datasets for enterprise reporting and operational decision-making.
- Build and maintain REST API integrations across federal and defense systems.
- Monitor, troubleshoot, and optimize scheduled workflows and production pipelines.
- Implement data validation, quality checks, lineage, governance, automated testing, documentation, and reusable engineering patterns.
Requirements
- U.S. Citizenship and an active DoW Secret or higher clearance are required.
- 3+ years of data engineering, software engineering, or related technical experience.
- Strong proficiency with Python and SQL, plus experience with Apache Spark or similar distributed data-processing frameworks.
- Experience with Databricks or a similar modern data platform, production pipelines, and ETL/ELT processes.
- Experience with data modeling, REST APIs, pipeline troubleshooting, performance optimization, and data reliability.
- Familiarity with data validation, quality, governance, security, privacy, compliance, Git workflows, terminal environments, and stakeholder communication.
Nice to have
- AWS, Palantir Foundry, Advana, GitLab, CI/CD, or automated deployment experience.
- Experience with very large datasets, including billions of records.
- Experience with federal health, financial, regulated, or sensitive data.
- Experience using AI-assisted development tools for engineering, testing, documentation, or debugging.
Culture & Benefits
- Flexible PTO and all federal holidays off.
- Health, dental, vision, FSA, life insurance, and short- and long-term disability coverage.
- 401(k) with employer match.
- Professional development through training, certifications, conferences, paid cloud developer accounts, and referral bonuses.
- Annual social events, hackathons, charity events, and access to Washington Capitals and Nationals tickets.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →