Senior Data Engineer (Data Platform)

TL;DR

Senior Data Engineer (Data Platform): Building and operating a next-generation lakehouse data platform with an accent on Spark-on-Kubernetes infrastructure, Apache Iceberg storage, and developer enablement frameworks. Focus on balancing cost and performance at scale while designing robust, event-driven data pipelines for a security-focused AI platform.

Location: Tel Aviv (Onsite)

Company

Cyera is a security operating model provider for the age of AI, offering a unified control plane to secure data, access, and behaviors across humans, systems, and AI.

What you will do

• Design and operate a Spark-on-Kubernetes compute platform with a focus on autoscaling and resource tuning.
• Manage the lakehouse storage layer using Apache Iceberg and AWS Glue, including partitioning and compaction strategies.
• Build shared frameworks and libraries to enable other engineers to deploy production-grade Spark jobs efficiently.
• Own production operations, including monitoring, alerting, and incident response for the data platform.
• Design scalable batch and streaming pipelines using Kafka for reliable data movement.
• Optimize platform cost and performance by right-sizing compute and tuning query execution.

Requirements

• 5+ years of experience in software engineering with a focus on large-scale data platforms.
• Strong hands-on experience with distributed processing engines, specifically Spark.
• Practical experience deploying and operating workloads in Kubernetes environments.
• Strong proficiency in SQL, data modeling, and query tuning.
• Solid software engineering fundamentals in Python, Scala, or Java.
• Experience with cloud-native data infrastructure on AWS at high scale.

Nice to have

• Hands-on experience with Apache Iceberg, Delta Lake, or Hudi.
• Experience with Airflow at scale, including custom operators and multi-environment deployment.
• Background in cybersecurity-related data infrastructure or compliance-constrained environments.
• Experience with FinOps and cloud cost optimization for data workloads.

Culture & Benefits

• Opportunity to work at the technical heart of a company building security for the AI era.
• Collaborative environment where engineers own their work from design through deployment and operations.
• Focus on continuous learning, challenging the status quo, and shared team success.
• Impactful role where your infrastructure and frameworks serve as the foundation for the entire engineering organization.