javapythonsqlkuberneteskafkadata engineeringdockerscalaairflowsparkargo workflowsdelta lake
Вакансия из Hirify Global, списка международных tech-компаний Для мэтча и отклика нужен Plus
Пожаловаться
Зарплата и рынок
ЗП не указана
На похожих ролях по рынку
$58к$77кмедиана$82к
8 в выборке
На СНГ рынке: $3к/мес ($2.9к - $3.4к)
87
Хорошая вакансия
развернуть
Чётко очерченная роль в известной компании из сферы кибербезопасности даёт опыт работы с масштабными промышленными системами, но включает дежурства.
Кликните для подробной информации
Рабочие дежурстваАктуальный стекКибербезопасностьРазвитие и обучение
Оценка от Hirify AI
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Подключить Plus
Описание вакансии
Текст:
Hirify AI/Оригинал
TL;DR
Data Engineer II - Poland (Cybersecurity) (Spark/Kafka/Delta Lake): Building scalable batch and real-time data pipelines for internet-scale cybersecurity data with an accent on data quality, reliability, and performance. Focus on optimizing large-scale Spark jobs, implementing Argo-based orchestration, and maintaining reliable production data systems.
Location: Poland (Remote); office location: Centrum Biurowe Vinci, Krakow, Poland
Company
hirify.global develops cybersecurity and cloud services that protect data centers and clouds from advanced threats.
What you will do
Design and build scalable data pipelines processing internet-scale volumes of security data.
Develop and maintain batch and real-time ETL/ELT workflows using Spark, Kafka, and Delta Lake.
Own the full lifecycle of data systems, including building, deploying, monitoring, and optimizing production pipelines.
Write production-grade, tested code focused on data quality, reliability, and performance.
Collaborate with Data Science, SecOps, and Analytics teams to translate requirements into scalable data infrastructure.
Optimize large-scale Spark jobs, implement Argo-based data orchestration workflows, and participate in an on-call rotation.
Requirements
Hands-on experience in data engineering and building production data pipelines at scale.
Advanced proficiency in Apache Spark for large-scale batch and/or streaming data processing.
Good SQL skills and experience with SQL and/or NoSQL databases.
Production experience with streaming technologies such as Kafka, RabbitMQ, or SQS.
Experience with Python, Scala, or Java.
Experience with data modeling, schema design, and ETL/ELT patterns.
Hands-on experience with orchestration tools such as Airflow, Argo Workflows, or similar.
Experience with containerization and orchestration using Docker and Kubernetes.
Culture & Benefits
Remote work from Poland.
Opportunities to learn, grow, explore new roles, and build new skills.
Development programs including GROW and Mentoring.
Internal events such as the APEX Expo and access to LinkedIn Learning.
A 15-minute exploratory call with a recruiter is available to learn more about the role.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →