Data Engineer (Big Data)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
Data Engineer (Big Data/Cloud): Designing and implementing high-performance large-scale data architectures and pipelines with an accent on scalability, efficiency, and cloud cost optimization. Focus on building end-to-end data-driven projects, implementing CI/CD for workflows, and optimizing modern data stacks including Snowflake and Databricks.
Location: Israel - TLV
Company
is a leader in Behavioral Biometrics, leveraging machine learning to analyze digital behavior to combat fraud and protect financial institutions globally.
What you will do
- Define the direction of data architecture and determine the appropriate toolset for specific requirements.
- Manage end-to-end execution of large-scale data projects, including design, implementation, and maintenance.
- Optimize and monitor cloud costs associated with team data operations.
- Construct monitoring tools to ensure the reliability and efficiency of data processes.
- Implement and maintain CI/CD pipelines for data workflows.
Requirements
- 5+ years of experience in data engineering and big data at large scales.
- Extensive experience with a modern data stack (e.g., Snowflake, Delta Lake, Iceberg, BigQuery, or Redshift).
- Proficiency with PySpark, Databricks, and real-time processing tools like Kafka or RabbitMQ.
- Strong software development background in Python/OOP for building large-scale pipelines.
- Hands-on experience with Docker and Kubernetes.
- Expertise in ETL development, data modeling, and data warehousing best practices.
Nice to have
- Knowledge of monitoring and observability tools such as Datadog, Prometheus, or ELK.
- Experience with Infrastructure as Code (IaC) and automation using Terraform, Helm, ArgoCD, GitHub Actions, or Jenkins.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →