Вакансия из Telegram канала - Мэтч & Сопровод
Покажет вашу совместимость и напишет письмо
Описание вакансии
Data Engineer — payabl.
Limassol, Cyprus · Hybrid · Full-time
payabl. is looking for a Data Engineer to join its Data Team and help build scalable data lakehouse solutions, streaming pipelines, and business-ready analytics layers.
The role is focused on AWS-based lakehouse architecture, CDC, Kafka, Debezium, Apache Iceberg, PySpark, Airflow, data quality, governance, and medallion architecture.
Main responsibilities:
• design, build, and maintain scalable data lakehouse solutions on AWS using S3, Apache Iceberg, and AWS Glue Catalog;
• contribute to the evolution of bronze, silver, and gold layers in a medallion architecture;
• build and support real-time and near-real-time ingestion pipelines;
• stream operational data from on-premise databases into AWS using Debezium, Kafka, Kafka Connect, and Iceberg sinks;
• monitor and troubleshoot streaming pipelines, connector issues, schema changes, data consistency, and ingestion reliability;
• design and implement silver and gold layer datasets;
• transform raw operational data into trusted business-ready data products;
• work with analysts, analytics engineers, and business stakeholders;
• develop and maintain batch and distributed processing jobs using PySpark on AWS EMR and AWS Glue;
• optimize transformation jobs for performance, scalability, reliability, and cost efficiency;
• build and maintain workflows using Apache Airflow;
• support API ingestion, batch processing, and third-party integrations with tools such as Airbyte;
• implement data quality checks, validation processes, and reconciliation logic;
• contribute to documentation, ownership, lineage, access, and compliance practices;
• collaborate on AWS infrastructure and deployment practices;
• support infrastructure-as-code workflows using Terraform and Terragrunt.
Requirements:
• 3+ years of experience in data engineering or related roles;
• strong SQL and data modeling experience for analytics and reporting;
• strong Python experience, ideally with PySpark;
• experience designing and maintaining ETL/ELT pipelines in production;
• experience with real-time or near-real-time data ingestion;
• Kafka or similar streaming technologies;
• CDC concepts and tools such as Debezium;
• cloud data lake or lakehouse architecture experience;
• AWS data services such as S3, Glue Catalog, Glue Jobs, EMR, and IAM;
• Apache Iceberg, Delta Lake, or similar open table formats;
• experience designing curated analytics layers such as silver and gold layers;
• Apache Airflow, Dagster, or similar orchestration tools;
• relational databases such as MySQL, MariaDB, or PostgreSQL;
• Unix/Linux and shell scripting;
• understanding of data quality, governance, lineage, and production monitoring.
Nice to have:
• Apache Druid, ClickHouse, Snowflake, Databricks, or other analytical databases and warehouse platforms;
• Airbyte or similar data integration tools;
• dbt or collaboration with analytics engineering teams;
• Terraform and Terragrunt;
• Docker and Kubernetes;
• Spark optimization on EMR or AWS Glue;
• Tableau, Power BI, Superset, or AWS QuickSight;
• data observability, alerting, and monitoring tools.
Benefits:
• Provident Fund after probation;
• annual learning budget after probation;
• €150 monthly Wolt allowance;
• SportsBenefits membership;
• possible company car after one year;
• complimentary parking near the office;
• 25 vacation days plus public holidays;
• 10 sick days;
• local discount card and event tickets;
• free Greek language classes twice a week;
• company celebrations and international events.
Hiring process:
1. Thinking in Action — 45 minutes
2. Build in Production — 60–90 minutes
3. Final Interview — 45 minutes
Location:
• remote from Poland or Portugal;
• on-site or hybrid in Cyprus.
Link:
Limassol, Cyprus · Hybrid · Full-time
payabl. is looking for a Data Engineer to join its Data Team and help build scalable data lakehouse solutions, streaming pipelines, and business-ready analytics layers.
The role is focused on AWS-based lakehouse architecture, CDC, Kafka, Debezium, Apache Iceberg, PySpark, Airflow, data quality, governance, and medallion architecture.
Main responsibilities:
• design, build, and maintain scalable data lakehouse solutions on AWS using S3, Apache Iceberg, and AWS Glue Catalog;
• contribute to the evolution of bronze, silver, and gold layers in a medallion architecture;
• build and support real-time and near-real-time ingestion pipelines;
• stream operational data from on-premise databases into AWS using Debezium, Kafka, Kafka Connect, and Iceberg sinks;
• monitor and troubleshoot streaming pipelines, connector issues, schema changes, data consistency, and ingestion reliability;
• design and implement silver and gold layer datasets;
• transform raw operational data into trusted business-ready data products;
• work with analysts, analytics engineers, and business stakeholders;
• develop and maintain batch and distributed processing jobs using PySpark on AWS EMR and AWS Glue;
• optimize transformation jobs for performance, scalability, reliability, and cost efficiency;
• build and maintain workflows using Apache Airflow;
• support API ingestion, batch processing, and third-party integrations with tools such as Airbyte;
• implement data quality checks, validation processes, and reconciliation logic;
• contribute to documentation, ownership, lineage, access, and compliance practices;
• collaborate on AWS infrastructure and deployment practices;
• support infrastructure-as-code workflows using Terraform and Terragrunt.
Requirements:
• 3+ years of experience in data engineering or related roles;
• strong SQL and data modeling experience for analytics and reporting;
• strong Python experience, ideally with PySpark;
• experience designing and maintaining ETL/ELT pipelines in production;
• experience with real-time or near-real-time data ingestion;
• Kafka or similar streaming technologies;
• CDC concepts and tools such as Debezium;
• cloud data lake or lakehouse architecture experience;
• AWS data services such as S3, Glue Catalog, Glue Jobs, EMR, and IAM;
• Apache Iceberg, Delta Lake, or similar open table formats;
• experience designing curated analytics layers such as silver and gold layers;
• Apache Airflow, Dagster, or similar orchestration tools;
• relational databases such as MySQL, MariaDB, or PostgreSQL;
• Unix/Linux and shell scripting;
• understanding of data quality, governance, lineage, and production monitoring.
Nice to have:
• Apache Druid, ClickHouse, Snowflake, Databricks, or other analytical databases and warehouse platforms;
• Airbyte or similar data integration tools;
• dbt or collaboration with analytics engineering teams;
• Terraform and Terragrunt;
• Docker and Kubernetes;
• Spark optimization on EMR or AWS Glue;
• Tableau, Power BI, Superset, or AWS QuickSight;
• data observability, alerting, and monitoring tools.
Benefits:
• Provident Fund after probation;
• annual learning budget after probation;
• €150 monthly Wolt allowance;
• SportsBenefits membership;
• possible company car after one year;
• complimentary parking near the office;
• 25 vacation days plus public holidays;
• 10 sick days;
• local discount card and event tickets;
• free Greek language classes twice a week;
• company celebrations and international events.
Hiring process:
1. Thinking in Action — 45 minutes
2. Build in Production — 60–90 minutes
3. Final Interview — 45 minutes
Location:
• remote from Poland or Portugal;
• on-site or hybrid in Cyprus.
Link:
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Текст вакансии взят без изменений
Источник -
