Senior Data Engineer (Airflow/Databricks)

Location: Tel Aviv, Israel; 4 days per week in the office

Company

Food intelligence and marketing platform that converts consumer behavior data into insights for food and beverage companies.

What you will do

• Own the end-to-end architecture and delivery of web-scale data ingestion pipelines, including scraping, transformation, and storage.
• Build and maintain resilient scrapers that handle dynamic content and changing anti-bot measures.
• Build and manage distributed cloud-based pipelines supporting real-time analytics and AI model deployment.
• Identify and resolve data quality issues before production to maintain accuracy and consistency across sources.
• Design scalable APIs and system architectures that connect pipeline decisions to business value and consumer-trend accuracy.
• Monitor, troubleshoot, and continuously improve data workflows as the platform scales.

Requirements

• 5+ years of experience in data engineering or backend roles focused on high-volume data processing.
• Experience with Airflow and Databricks.
• Expert-level web scraping skills, including resilient scrapers for dynamic content and anti-bot environments.
• End-to-end ownership of data pipelines and proactive data quality management.
• Strong technical depth in distributed systems, cloud architecture, low-latency data modeling, system design, and scalable API architectures.
• Active use of LLMs and AI coding assistants such as Claude Code and Codex.

Culture & Benefits

• Collaborative R&D environment focused on food, technology, data, and real-world industry impact.
• Work directly on a food-intelligence engine used by leading food and beverage companies.
• Office-based work in Tel Aviv four days per week.