обновлено 4 дня назад
Senior Data Engineer (AWS)
160 000 - 180 000$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (AWS): Building and operating a secure, scalable enterprise lakehouse platform for DoD analytics, AI/ML initiatives, and operational reporting with an accent on Apache Iceberg, Apache Spark, AWS, and data governance. Focus on optimizing distributed data processing, designing event-driven ingestion, managing infrastructure with Terraform, and leading technical discussions and mentoring engineers.
Location: Remote; active Secret Clearance required
Salary: $160,000–$180,000 annually
Company
builds secure Software Factories and high-performance software solutions using open technologies for DoD, healthcare, and civilian government agencies.
What you will do
- Architect, build, and operate an enterprise lakehouse on AWS using Apache Iceberg, Amazon S3, and AWS Glue Catalog.
- Develop and optimize Apache Spark pipelines across EMR and Kubernetes environments.
- Design event-driven ingestion solutions using S3 events and Amazon SQS.
- Optimize queries across Athena, Trino, and Spark SQL, and orchestrate workflows with Apache Airflow.
- Automate infrastructure deployment with Terraform and maintain data products, dashboards, documentation, and operational runbooks.
- Provide technical leadership, mentor junior engineers, and collaborate with data scientists, AI engineers, cloud engineers, and stakeholders.
Requirements
- Active Secret Clearance required.
- 8+ years of professional experience in data engineering or large-scale data platform development.
- Advanced Apache Spark expertise, including performance tuning, partitioning, memory optimization, and data-skew management.
- Strong Python or Scala skills and advanced SQL development experience.
- Hands-on AWS experience with S3, Glue, EMR, Athena, EC2, SQS, and event-driven architectures.
- Experience with Apache Iceberg or Delta Lake, Apache Airflow, Terraform, Kubernetes, dashboards, data quality, governance, lineage, and access controls.
Nice to have
- Enterprise-scale Apache Iceberg operations and Trino administration.
- Experience with dbt, Helm, GitOps, or modern data visualization platforms.
- AWS Data Analytics Certification or Certified Kubernetes Administrator certification.
- DoD, USAF, or federal government data platform experience.
- Experience supporting AI/ML, data science, or advanced analytics workloads.
Culture & Benefits
- Collaborative environment with strategists, engineers, designers, and creators.
- Medical, dental, and vision plans with employee-only healthcare coverage fully paid by the employer.
- Life insurance and flexible combined paid time off, including bereavement leave and 11 company-paid holidays.
- 401(k) retirement plan with employer match.
- Professional development training reimbursement.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
5 дней назад
Senior Data Engineer
155 000 - 175 000$
4 дня назад
Senior Data Infrastructure Engineer (AWS)
155 000 - 192 000$
6 дней назад
Senior Data Engineer (Spark)
138 942 - 218 550$
6 дней назад
Senior Data Engineer (AI)
95 000 - 135 000$
10 дней назад
Senior Data Engineer (AWS)
105 700 - 149 275$
11 дней назад
Sr./Staff Data Engineer
160 000 - 180 000$