3 дня назад
Data Engineer (AI)
hhВакансия с HeadHunter. Контакт ведёт на hh.ru
Мэтч & Сопровод
Покажет вашу совместимость и напишет письмо
Описание вакансии
Текст:
TL;DR
Data Engineer (AI) (Python/Spark/SQL): Building and optimizing fault-tolerant ETL/ELT pipelines, medallion data architectures, dimensional models, and reporting marts with an accent on scalable data delivery, data quality contracts, and SLA performance. Focus on tuning Spark jobs, diagnosing Kafka and dbt pipeline failures, and designing AI-assisted data engineering workflows.
Location: Israel; 100% remote
Salary: Attractive USD compensation
Company
Nitka Technologies develops software for customers in the US and Europe and brings together approximately 300 professionals across Eastern Europe, North and South America, Armenia, Georgia, and Kazakhstan.
What you will do
- Lead discovery and requirements-gathering sessions with business stakeholders.
- Document source schemas and define analytics-ready data models, including foundational tables, star schemas, and reporting marts.
- Build, optimize, and maintain fault-tolerant ETL/ELT pipelines using dbt macros, incremental models, and snapshot patterns.
- Design medallion architecture layers with defined SLAs and data quality contracts.
- Tune Spark jobs, optimize partitions and shuffle performance, and diagnose complex Kafka, Spark, and dbt pipeline issues.
- Create technical documentation, data model diagrams, and operational runbooks for production support.
Requirements
- 5+ years of data engineering experience.
- Advanced proficiency in Python, Spark, and SQL.
- Strong experience with AWS and Databricks.
- Familiarity with Kafka and modern data stack tools such as dbt and Airflow or equivalent.
- Deep understanding of dimensional modeling, star and snowflake schemas, medallion architecture, data warehouse design, and lambda, kappa, and lakehouse topologies.
- Strong spoken English at Intermediate level or higher.
Nice to have
- Experience using Great Expectations or similar frameworks for automated data quality checks.
- Ability to structure problems for AI assistance and design pipelines that assume AI-assisted development.
Culture & Benefits
- 100% remote work on a long-term project.
- Full-time schedule of 8 hours per day.
- USD compensation.
- Paid vacation and holidays.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →