2 дня назад
Data Engineer (AWS/Snowflake)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Engineer (AWS/Snowflake): Designing and developing data pipelines to fulfill business needs with an accent on batch and real-time data loading and visualization. Focus on building ingestion processes from Kafka and APIs using AWS MSK Connect and maintaining platforms using Spark Structured Streaming.
Location: Athens, Greece
Company
is a large-scale international gaming company with over 1,700 employees across 7 offices.
What you will do
- Maintain and evolve the existing data platform.
- Build processes to ingest data from Kafka, APIs, and Databases using AWS MSK Connect.
- Develop real-time data processing applications using Spark Structured Streaming and Kafka Streams.
- Implement data modelling following Inmon, Kimball, and Data Vault standards.
- Ensure data quality by verifying data consistency and accuracy.
- Take full ownership of assigned projects and perform knowledge sharing sessions.
Requirements
- Experience with Snowflake, Airflow, and AWS Glue.
- Proficiency in Apache Iceberg, SQL, and Data Integration Tools.
- Experience with Python or Scala.
- Knowledge of AWS Services such as S3, Lambda, API Gateways, DMS, and RDS.
- Development experience in both Microsoft and Linux/Cloud environments.
- Strong analytical and problem-solving skills.
Nice to have
- Familiarity with Docker, Kubernetes, and Terraform.
- Experience with Elasticsearch, Kafka, Prometheus, Grafana, and Cloudwatch.
- Knowledge of Data Warehousing concepts and data modelling techniques.
- At least 2 years of experience in Data Engineering.
- Excellent verbal and writing English communication skills.
Culture & Benefits
- Dynamic, fast-paced, and high-energy work environment.
- Opportunity to work in a large, millennial-driven international team.
- Culture that encourages go-getters and initiators to push boundaries.
- Collaborative environment spread across multiple global offices.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →