14 часов назад
Senior Data Engineer
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (Spark/Python/SQL): Building scalable data pipelines, APIs, and data products that integrate complex defense and federal health data with an accent on production reliability, reusable engineering patterns, and data quality. Focus on designing Databricks-based distributed processing, optimizing large-scale workflows, and solving security, governance, and integration challenges across sensitive data systems.
Location: Remote within the continental United States; periodic travel may be required
Company
delivers technology and data solutions for mission-critical government and federal health initiatives.
What you will do
- Design, develop, and maintain production-ready data pipelines and data products using Spark, Python, SQL, and Databricks.
- Integrate and transform complex data from defense and federal health systems into reliable, reusable data products.
- Design scalable data ingestion, exchange, and API-based integration services.
- Establish reusable engineering patterns, standards, and best practices for data products.
- Monitor, troubleshoot, and optimize production workflows for performance, reliability, and scalability.
- Provide technical guidance and mentorship to engineers while collaborating with architects, analysts, and customer stakeholders.
Requirements
- U.S. citizenship and an active DoW Secret or higher clearance are required.
- Bachelor’s degree in Computer Science, Engineering, Data Science, or a related technical field is preferred.
- 10+ years of data engineering, software engineering, or related technical experience.
- Advanced Python and SQL skills, with strong experience in Apache Spark, Databricks, distributed processing, and large-scale ETL/ELT.
- Experience with data modeling, architecture, quality, governance, API integrations, Git-based workflows, and command-line environments.
- Ability to mentor engineers, communicate with technical and non-technical stakeholders, navigate ambiguity, and address security, privacy, and compliance issues.
Nice to have
- AWS, GitLab, Palantir Foundry, Advana, or similar DoW data environment experience.
- Experience with datasets containing billions of records.
- Experience with federal health, financial, or other regulated and sensitive data.
- Experience using AI/ML to automate routine tasks and accelerate development or debugging.
Culture & Benefits
- Flexible PTO and all federal holidays off.
- Health, dental, vision, FSA, life insurance, and short- and long-term disability coverage.
- 401(k) with employer match.
- Professional development through training, certifications, conferences, and paid cloud developer accounts.
- Referral bonuses, annual social events, and access to Washington Capitals and Nationals tickets.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →