3 дня назад
AWS Data Engineer - Data Platform
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
AWS Data Engineer - Data Platform (AWS/Data Platform): Building scalable data platforms, pipelines, storage, and infrastructure foundations for analytics and data-driven products with an accent on AWS services, Terraform, Snowflake, orchestration, and data quality. Focus on provisioning cloud infrastructure, managing containerized pipeline services, implementing observability and governance, and solving production reliability issues.
Location: Hyderabad, India
Company
is a technology platform delivering enterprise solutions and data insights for the life and annuities insurance industry.
What you will do
- Build and maintain scalable data platforms and pipelines supporting analytics and data-driven products.
- Implement and tune AWS storage, IAM, compute, orchestration, telemetry, and observability components.
- Provision AWS and Snowflake infrastructure with Terraform, including S3, IAM, Lambda, RDS/Aurora, warehouses, roles, and databases.
- Develop and manage containerized pipeline services with Docker, Kubernetes/EKS, or ECS, including EKS upgrades and configuration changes.
- Develop ELT/ETL workflows using Airflow, dbt, and Airbyte or similar tools, while implementing data quality checks, monitoring, lineage, governance, and cost optimization.
- Troubleshoot platform and pipeline issues, document solutions, and collaborate with senior engineers and downstream data teams.
Requirements
- 4+ years of experience in Data Platform Engineering.
- Hands-on experience with AWS core services, including S3, IAM, and compute services.
- Strong SQL and Python skills for data transformation and pipeline development.
- Experience with Snowflake or a similar cloud data warehouse and working knowledge of data modeling fundamentals.
- Experience with Airflow, including managed Airflow such as MWAA, and awareness of dbt Cloud for transformations, testing, documentation, and job configuration.
- Ability to work in agile, cross-functional teams with senior engineers, analysts, and data scientists.
Nice to have
- Exposure to MLOps, including training data pipelines, feature generation, or model monitoring data.
- Experience with Airbyte or similar ELT ingestion tools.
- Experience with CI/CD for data pipelines, GitHub repositories, and GitHub Actions.
- Experience in insurance or financial services.
Culture & Benefits
- Collaborate with professionals focused on technology, data insights, and insurance services.
- Work in an agile, cross-functional environment with engineers, analysts, and data scientists.
- Contribute to a diverse workforce as part of an equal opportunity employer.
Hiring process
- Apply through the online application on the careers website.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →