Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (AI): Building and owning production-grade data pipelines for analytics and machine learning with an accent on Python, SQL, reliability, and cost-efficient cloud execution. Focus on designing stateless and idempotent processing, orchestrating workloads with Airflow and Kubernetes, and delivering trusted datasets to Analytics, Data Science, and ML teams.
Location: Tel Aviv, Israel. The role is available to work from the Tel Aviv office, and applicants must be authorized to work in the country of application.
Company
Nebius builds a full-stack AI cloud platform for data processing, model training, and production deployment.
What you will do
- Design, build, and own production-grade data pipelines using Python and SQL.
- Develop stateless and idempotent pipelines resilient to retries, failures, and infrastructure interruptions.
- Implement data transformations, validation, and data quality checks while optimizing performance, reliability, and cost.
- Collaborate with Analytics, Data Science, and ML teams to deliver trusted datasets.
- Orchestrate workloads with Airflow or an equivalent framework, package them with Docker, and deploy them on Kubernetes.
- Build CI/CD automation and provision pipeline infrastructure using Infrastructure as Code.
Requirements
- 8+ years of experience as a Data Engineer, primarily focused on building data pipelines.
- 6+ years of hands-on experience with Python and SQL.
- 3+ years of experience running workloads on Kubernetes.
- Strong understanding of stateless system design, idempotent data processing, cloud environments, and workflow orchestration.
- Strong Linux fundamentals and production debugging skills.
- Working knowledge of spoken and written English and authorization to work in the country of application are required.
Nice to have
- Experience with open-source software, Apache Spark, or similar distributed processing frameworks.
- Experience building data pipelines for machine learning workflows.
- Familiarity with Spot or Preemptible compute and cost-optimized data processing.
- Experience with relational and non-relational data stores and large-scale or high-reliability data systems.
- Experience collaborating with Data Science and ML teams.
Culture & Benefits
- Competitive compensation and career growth opportunities.
- Learning opportunities, flexibility, and ownership.
- Collaborative, innovative, and international working environment.
- Opportunity to work on impactful AI projects with experienced engineering and research teams.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →