обновлено 2 дня назад
Middle/Senior Data Engineer (AWS)
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Middle/Senior Data Engineer (AWS): Building a new AWS data lake and analytics platform for an EdTech learning system with an accent on ingestion pipelines, lakehouse architecture, data quality, and student-data privacy. Focus on designing scalable raw, cleaned, and curated data zones, implementing PII governance and access controls, and delivering analytics-ready datasets for district reporting.
Location: Remote
Company
develops IT solutions for US and European markets with a team of more than 170 IT professionals.
What you will do
- Design the AWS data lake architecture, including raw, cleaned, and curated zones, data modeling, and partitioning.
- Build ingestion pipelines from MySQL/RDS, application events, and third-party sources using CDC, batch, and incremental loading.
- Develop ETL/ELT jobs and transformations with AWS Glue, PySpark, and SQL, including data quality checks and monitoring.
- Prepare analytics-ready datasets for learning analytics, usage analysis, dashboards, and district-level reporting.
- Implement data governance for district opt-in, PII handling, encryption, access control, auditing, and FERPA/COPPA compliance.
- Define infrastructure as code with Terraform, participate in Agile/Scrum activities, estimate work, and present results to the customer.
Requirements
- 4+ years of commercial Data Engineering experience.
- Hands-on AWS experience with S3, Glue, Data Catalog, Athena, Lake Formation/IAM, Lambda, and Step Functions.
- Experience building a data lake or lakehouse from scratch, including Parquet, Iceberg/Delta/Hudi, and partitioning.
- Strong Python/PySpark and advanced SQL skills, plus experience with relational database ingestion and CDC using AWS DMS or similar tools.
- Knowledge of orchestration, analytics data modeling, data quality testing, PII security, Terraform or CDK, Git, and CI/CD basics.
- English level: B2 or higher.
Nice to have
- Experience with Redshift, QuickSight, Power BI, Tableau, Superset, or dbt.
- Experience with streaming technologies such as Kinesis or Kafka.
- EdTech, student-data privacy, FERPA, or COPPA experience.
- AWS Data Engineer or Data Analytics certification.
Culture & Benefits
- Remote full-time work within an international IT solutions environment.
- Collaboration with a US-based EdTech customer serving K-12 schools.
- Participation in technical discussions, estimation, Agile/Scrum ceremonies, and customer presentations.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →