Назад
Company hidden
обновлено 9 дней назад

Senior Data Engineer (AWS)

112 700 - 146 900$
Формат работы
onsite
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Senior Data Engineer (AWS): Building and operating scalable production-grade ELT pipelines and analytics-ready datasets across an AWS Lakehouse with an accent on event-driven ingestion, Medallion architecture, and data quality. Focus on designing distributed data workflows with Python, SQL, and PySpark, provisioning infrastructure with Terraform, and optimizing pipelines for Power BI, reliability, and cost efficiency.

Location: Rockville, Maryland, United States; onsite at 12601 Twinbrook Parkway

Salary: $112,700–$146,900 annually. Target annual bonus varies by role level.

Company

USP is an independent scientific organization developing quality standards for medicines, dietary supplements, and food ingredients through global collaboration with health and science experts.

What you will do

  • Design, develop, and maintain scalable ELT pipelines supporting batch and event-driven workflows from ERPs, APIs, vendor files, and relational databases.
  • Build and optimize AWS-native pipelines using Medallion Lakehouse architecture, with attention to performance and cost efficiency.
  • Provision AWS infrastructure with Terraform and maintain CI/CD pipelines, automated testing, monitoring, alerting, and recovery mechanisms.
  • Develop dimensional models and Gold-layer datasets with SQL, Python, and PySpark, including schema-drift handling, audit tracking, partitioning, clustering, and materialization.
  • Implement data validation, anomaly detection, lineage tracking, and metadata management.
  • Collaborate with Data Architects, Analytics teams, business stakeholders, and Power BI developers to resolve complex data issues and align reporting datasets with business requirements.

Requirements

  • Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field, or equivalent experience.
  • 7+ years of data engineering experience with strong AWS, big data, and distributed data technology expertise.
  • Strong Python and SQL skills with hands-on PySpark/Spark experience.
  • Experience with AWS Glue, Step Functions, Lambda, S3, Athena, SNS, SQS, Redshift, and event-driven pipeline architectures.
  • Experience with Medallion data lake or Lakehouse architecture, dimensional modeling, vendor-file processing, Terraform, CI/CD, Power BI integration, and UNIX/Linux scripting.
  • Production experience with monitoring, troubleshooting, on-call data pipeline support, and Agile engineering practices.

Nice to have

  • Oracle EBS integration experience.
  • Experience with Great Expectations, dbt tests, data catalog, and data lineage tools such as Alation or Collibra.
  • Experience with AWS CDK or CloudFormation and relevant AWS certifications.

Culture & Benefits

  • Work in support of global public health standards and access to high-quality medicines.
  • Inclusive, collaborative environment focused on scientific integrity, fairness, and professional development.
  • Company-paid time off and comprehensive healthcare options.
  • Retirement savings benefits and leadership and workforce development programs.

Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →