7 дней назад
Senior Data Engineer (AI)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (AI): Designing and optimizing cloud-based data platforms and batch, streaming, and near-real-time pipelines for analytics, AI, and data products with an accent on Spark, Delta Lake, Databricks, and lakehouse architectures. Focus on building production-grade datasets and GenAI pipelines, implementing governance and observability, and translating business needs into scalable data solutions.
Location: Sofia, Bulgaria; hybrid work options available
Company
is an experience innovation company helping recognized brands create digital products and transform their businesses through data, AI, creativity, and technology.
What you will do
- Design, build, and optimize cloud-based data platforms and scalable batch, streaming, and near-real-time pipelines.
- Develop lakehouse architectures, medallion layers, ingestion workflows, and curated datasets for structured and unstructured data.
- Enable analytics, machine learning, causal modeling, GenAI, RAG, vector-based, and agent-based applications.
- Design data models and orchestrate reliable workflows using tools such as Airflow, dbt, Databricks Workflows, and Azure Data Factory.
- Implement data governance, lineage, quality, access control, observability, monitoring, and SLA adherence.
- Collaborate with data scientists, ML engineers, analysts, platform teams, and business stakeholders to shape requirements and deliver production-grade data solutions.
Requirements
- Strong hands-on experience with Apache Spark, Delta Lake, Python, and SQL.
- Proven experience building batch and streaming pipelines and production-grade data platforms.
- Deep expertise in at least one core platform track: AWS with Databricks, or Azure/Fabric with Databricks or native Fabric tooling.
- Experience with lakehouse architectures, distributed data systems, data modeling, scalability, reliability, performance, data quality, and governance.
- Strong problem-solving, analytical, and collaborative skills, with the ability to derive and challenge business requirements.
Nice to have
- Experience with both AWS and Azure/Fabric, or with Snowflake and GCP.
- Experience with GenAI data systems, RAG pipelines, vector databases, LLM data preparation, or ML platforms.
- Knowledge of CI/CD, Terraform, CloudFormation, Kafka, Spark optimization, causal modeling, experimentation platforms, or large-scale data products.
- Experience in Agile or consulting environments.
Culture & Benefits
- Hybrid work options with 25 vacation days.
- Co-subsidized transportation, Multisport cards, and premium health insurance.
- Training for technical events, courses, and certifications.
- Career development roadmap supported by performance evaluations.
- Psychological consultations, team events, and a comfortable office environment.
- Inclusive culture focused on creativity, diversity, autonomy, and continuous learning.
Hiring process
- Talent Acquisition reviews applications and relevant experience.
- Applications are assessed based on skills, experience, and potential; age, gender, marital status, and headshots are not required.
- Reasonable accommodations are available during the interview process.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
8 дней назад
Junior Data Engineer (Databricks)
9 дней назад
Data Engineer (Azure)
2 800 - 4 550€
9 дней назад
Lead Data Engineer (Azure)
4 000 - 5 300€
12 дней назад
Senior Data Engineer (Snowflake)
12 дней назад
Senior Data Engineer (SAP BW/Snowflake)
12 дней назад