Master Data Developer (AWS)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
Master Data Developer (AWS): Designing, building, and optimizing scalable data pipelines and lake architectures for large enterprises with an accent on distributed data processing and cloud-native AWS services. Focus on implementing robust ETL/ELT processes, refining partitioning strategies for data lake storage, and migrating legacy RDBMS workloads to cloud environments.
Location: Remote (Colombia)
Company
is a global technology company helping large enterprises transform AI potential into real business impact through tech-integrated solutions and AI-native execution.
What you will do
- Design, build, and maintain robust ETL/ELT processes to ingest and transform data across a modern Data Lake architecture.
- Develop and optimize distributed data processing workflows using Python and PySpark for large-scale datasets.
- Write and optimize complex SQL queries and migrate data pipelines from legacy RDBMS platforms to cloud-native environments.
- Manage AWS-native services including Glue (Jobs, Catalog, Workflows), Athena, Redshift, S3, and Lambda.
- Collaborate with DevOps to provision and manage data resources using IaC tools like CloudFormation, CDK, or Terraform.
- Ensure data integrity and implement observability frameworks to monitor pipeline health and SLAs.
Requirements
- Must be based in Colombia.
- English: Advanced/Fluent (C1).
- Strong proficiency in AWS, Python, and PySpark for distributed data processing.
- Deep understanding of SQL, including CTEs, window functions, and aggregations.
- Hands-on experience with AWS Glue, Athena, and Redshift.
- Solid understanding of Data Lake architectures and object-oriented programming (OOP) principles.
Nice to have
- Experience with open table formats such as Delta Lake or Apache Iceberg.
- Knowledge of TypeScript.
- Practical experience with Infrastructure as Code (IaC) tools.
- Familiarity with SageMaker AI, ECS, RDS, DynamoDB, and EventBridge.
- Experience using Pandas for data manipulation.
Culture & Benefits
- Fully remote work environment (Homeoffice).
- Opportunity to work in an AI-native execution culture.
- Collaborative international environment with teams across 25+ countries.
- Focus on continuous innovation and technological transformation.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →