Senior Data Engineer (Cybersecurity)

TL;DR

Senior Data Engineer (AWS/Spark): Building and optimizing a secure, scalable Data Lake to power global search and analytics with an accent on end-to-end data pipelines and Lakehouse architecture. Focus on optimizing processing performance for large-scale datasets and ensuring system reliability in production.

Location: Israel - Petah Tikva

Company

AI-powered Digital Investigation Platform enabling lawful access and analysis of digital evidence to accelerate justice.

What you will do

• Build and maintain end-to-end batch and streaming data pipelines.
• Design and improve Data Lake and Lakehouse architectures.
• Optimize processing performance for large-scale, complex datasets.
• Structure data to support search and indexing systems.
• Ensure data quality, reliability, and scalability in production.
• Collaborate with backend, data, and product teams from design to deployment.

Requirements

• 8+ years of experience in data engineering or related fields.
• Strong hands-on experience with Spark and PySpark.
• Proven experience building and operating data pipelines in production environments.
• Solid experience with AWS data services (S3, EMR, Glue, Athena, Lambda, Kinesis).
• Strong Python skills and experience with large-scale distributed systems.
• Location: Must be based in Petah Tikva, Israel

Nice to have

• Experience with Iceberg or Lakehouse architectures.
• Experience with streaming pipelines, CDC, or real-time processing.
• Familiarity with search technologies like Elasticsearch or OpenSearch.
• Experience with Infrastructure as Code (Terraform, CDK).

Culture & Benefits

• Competitive compensation and benefits.
• Opportunity to work on large-scale, real-world systems.
• High ownership and meaningful technical challenges.
• Collaborative and experienced team environment.