обновлено 8 дней назад
Senior Data Engineer (AI)
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (AI): Building and maintaining highly available data pipelines, data access APIs, and storage systems for AI and algorithm training across edge and cloud environments with an accent on multi-dimensional data, database optimization, and low-latency access. Focus on designing event-driven integrations, optimizing cloud data costs, and enabling efficient collaboration between software, AI, and algorithms teams.
Location: Tel Aviv, Tel Aviv District, Israel
Company
is a fast-growing startup developing fiber-sensing solutions for monitoring electrical power grids and oil & gas pipelines across thousands of kilometers, using AI and machine learning to support utility operations and environmental targets.
What you will do
- Design data collection processes for textual and multi-dimensional data.
- Implement data search and access APIs between edge-computing and cloud environments.
- Develop and optimize data, metadata, and database storage for efficient AI and algorithm training and testing.
- Analyze existing data schemas and processes and implement improvements.
- Optimize cloud data usage and cost structures while maintaining low-latency access.
- Collaborate with Software, AI, and Algorithms teams on system integration, data access, and ongoing data requests.
Requirements
- 5+ years of professional experience in data engineering or related roles, including hands-on design and implementation of data pipelines with orchestration frameworks such as Apache Airflow or Prefect.
- Experience with event-driven models and asynchronous messaging, including Kafka or RabbitMQ.
- 5+ years of experience and deep understanding of SQL and NoSQL databases, including MySQL, Elastic, MongoDB, PostgreSQL, or ClickHouse.
- 5+ years of software development experience, including at least 2 years with Python.
- Strong command of version control systems such as Git, containerization such as Docker, and CI/CD pipelines.
- Strong collaboration skills with teams and peers.
- Innovative mindset and willingness to learn and grow.
Nice to have
- Experience with streaming technologies, unstructured data, and data types beyond text and tables.
- Experience with Hadoop, MapReduce, Spark, or another distributed computing platform.
- Experience with Kubernetes-based systems.
- Experience with data visualization and analysis tools such as Grafana, ELK, or Kibana.
Culture & Benefits
- Join a fast-growing startup building hardware and software for infrastructure monitoring.
- Work in a collaborative environment that values learning, constructive challenge, teamwork, and product focus.
- Contribute to data and technology supporting renewable energy and environmental goals.
Будьте осторожны
Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →
Музыка
Осень
Поддержка