2 дня назад
Senior Data Engineer (Big Data & Cloud Platforms)
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (Big Data & Cloud Platforms): Building and optimizing batch and real-time data pipelines for advanced financial data platforms with an accent on Python, Spark, cloud infrastructure, and lakehouse architecture. Focus on designing scalable data systems, improving Spark performance and cost-efficiency, and ensuring reliable data delivery for analytics and financial products.
Location: Porto, Portugal; hybrid work with up to 3 remote days per week. Candidates must already have the legal right to work in the European Union.
Company
provides technology and data engineering services for clients including financial services organizations.
What you will do
- Design, develop, test, and deploy batch and real-time ETL/ELT pipelines with Python and PySpark.
- Optimize data lakes, warehouses, and lakehouse storage and query performance using formats such as Delta Lake and Iceberg.
- Improve Spark job performance, memory management, scalability, and cost-efficiency.
- Implement monitoring, logging, and alerting to maintain pipeline reliability and resolve failures.
- Collaborate with Data Scientists, Analysts, and Product Managers to turn data requirements into scalable technical solutions.
- Contribute to code reviews, CI/CD, unit testing, and maintainable engineering practices.
Requirements
- 9+ years of experience in Data Engineering or a related field.
- Strong Python skills, including object-oriented programming, pandas, and testing frameworks.
- Hands-on experience with Apache Spark and PySpark.
- Excellent SQL skills and experience with relational databases and data warehouses such as PostgreSQL, MySQL, Snowflake, BigQuery, or Redshift.
- Experience with AWS, GCP, or Azure and workflow orchestration tools such as Airflow, Prefect, or Dagster.
- Fluent English and an existing legal right to work in the European Union are required.
Nice to have
- Knowledge of modern lakehouse formats such as Delta Lake or Iceberg.
- Certifications in cloud technologies or data engineering tools.
Culture & Benefits
- Hybrid work model based in Porto with up to three remote days per week.
- International collaboration with stakeholders across financial services and technology teams.
- Opportunity to work on scalable data platforms supporting innovative financial products and analytics.
- Participation in modern cloud, Big Data, and digital transformation initiatives.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →