2 дня назад
Senior Data Engineer (Data Unification)
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (Data Unification) (Big Data/Cloud): Building high-volume batch and streaming ingestion pipelines and next-generation data curation platforms across AWS and GCP with an accent on distributed systems, petabyte-scale data lakes, and production reliability. Focus on designing scalable data services, resolving data quality and lineage issues, and technically leading engineers across data engineering and software development.
Location: Fully remote; candidates located in the EU, Georgia, or Uzbekistan. Listed locations: Poland, Romania, Spain, and Uzbekistan.
Company
connects job seekers with career opportunities, including roles supporting marketplace technology for local businesses, live events, and travel destinations.
What you will do
- Design and develop high-volume batch and streaming data ingestion pipelines across AWS and GCP.
- Build and launch data ingestion, curation, data lake, and data warehouse platforms.
- Contribute to requirements definition and system and data architecture discussions.
- Lead and mentor junior engineers on software development and data engineering best practices.
- Collaborate with software engineers, data engineers, ML experts, and data analysts on new product features.
Requirements
- 10+ years of experience in distributed systems, data engineering, or software engineering, plus a BS/MS in Computer Science.
- Strong coding skills in Python, Java, or Scala, with strong SQL and NoSQL database experience.
- Experience with Hadoop, Hive, Apache Spark, Airflow, ETL, data lineage, data quality, backfills, and batch and streaming pipelines.
- Experience with GCP or AWS data processing at scale and with production services operating under tight SLAs.
- Experience with logging, metrics, monitoring, alerting, testing methodologies, CI/CD, and industry best practices.
- Remote work is available for candidates located in the EU, Georgia, or Uzbekistan.
Nice to have
- Google Data Streams and Google Dataproc experience.
- Experience with Change Data Capture technologies.
- Experience with modern data warehouse technologies such as Delta Lake.
Culture & Benefits
- Fully remote work.
- Work on an ongoing project involving cloud-based data platforms and large-scale data processing.
- Collaboration in cross-functional agile teams.
- Opportunity to mentor junior engineers and influence data engineering practices.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →