обновлено 9 дней назад
Senior Data Engineer (AWS)
112 700 - 146 900$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (AWS): Building and operating scalable production-grade ELT pipelines and analytics-ready datasets across an AWS Lakehouse with an accent on event-driven ingestion, Medallion architecture, and data quality. Focus on designing distributed data workflows with Python, SQL, and PySpark, provisioning infrastructure with Terraform, and optimizing pipelines for Power BI, reliability, and cost efficiency.
Location: Rockville, Maryland, United States; onsite at 12601 Twinbrook Parkway
Salary: $112,700–$146,900 annually. Target annual bonus varies by role level.
Company
USP is an independent scientific organization developing quality standards for medicines, dietary supplements, and food ingredients through global collaboration with health and science experts.
What you will do
- Design, develop, and maintain scalable ELT pipelines supporting batch and event-driven workflows from ERPs, APIs, vendor files, and relational databases.
- Build and optimize AWS-native pipelines using Medallion Lakehouse architecture, with attention to performance and cost efficiency.
- Provision AWS infrastructure with Terraform and maintain CI/CD pipelines, automated testing, monitoring, alerting, and recovery mechanisms.
- Develop dimensional models and Gold-layer datasets with SQL, Python, and PySpark, including schema-drift handling, audit tracking, partitioning, clustering, and materialization.
- Implement data validation, anomaly detection, lineage tracking, and metadata management.
- Collaborate with Data Architects, Analytics teams, business stakeholders, and Power BI developers to resolve complex data issues and align reporting datasets with business requirements.
Requirements
- Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field, or equivalent experience.
- 7+ years of data engineering experience with strong AWS, big data, and distributed data technology expertise.
- Strong Python and SQL skills with hands-on PySpark/Spark experience.
- Experience with AWS Glue, Step Functions, Lambda, S3, Athena, SNS, SQS, Redshift, and event-driven pipeline architectures.
- Experience with Medallion data lake or Lakehouse architecture, dimensional modeling, vendor-file processing, Terraform, CI/CD, Power BI integration, and UNIX/Linux scripting.
- Production experience with monitoring, troubleshooting, on-call data pipeline support, and Agile engineering practices.
Nice to have
- Oracle EBS integration experience.
- Experience with Great Expectations, dbt tests, data catalog, and data lineage tools such as Alation or Collibra.
- Experience with AWS CDK or CloudFormation and relevant AWS certifications.
Culture & Benefits
- Work in support of global public health standards and access to high-quality medicines.
- Inclusive, collaborative environment focused on scientific integrity, fairness, and professional development.
- Company-paid time off and comprehensive healthcare options.
- Retirement savings benefits and leadership and workforce development programs.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
9 дней назад
Principal Data Engineer (Biotech)
159 422 - 215 689$
9 дней назад
Senior Data Engineer
105 700 - 149 275$
9 дней назад
Senior Data Engineer (Azure)
121 116 - 151 395$
8 дней назад
Senior Data Engineer (AWS)
120 000 - 150 000$
6 дней назад
Data Engineer (Analytics)
149 000 - 180 000$
8 дней назад
Data Engineering Manager, Commercial US
148 500 - 214 500$