pythonsqlazureawsgcpsparkdatabrickspysparkdata governancedelta lake
Вакансия из Hirify Global, списка международных tech-компаний Для мэтча и отклика нужен Plus
Пожаловаться
Зарплата и рынок
ЗП не указана
На похожих ролях по рынку
$53к$63кмедиана$70к
31 в выборке
На СНГ рынке: $4к/мес ($3к - $5.9к)
78
Хорошая вакансия
развернуть
Обязанности очерчены достаточно ясно, а роль дает старший уровень ответственности за современные платформы данных; при этом в консалтинге проекты и приоритеты могут меняться.
Кликните для подробной информации
Оценка от Hirify AI
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Подключить Plus
Описание вакансии
Текст:
Hirify AI/Оригинал
TL;DR
Seniors/Leads Data Engineers (Databricks) (Databricks/Lakehouse): Building and optimizing scalable data pipelines, ETL/ELT processes, and analytics solutions on the Databricks Lakehouse platform with an accent on Apache Spark, Delta Lake, cloud integration, and data governance. Focus on designing secure architectures, automating infrastructure deployment, tuning distributed data workloads, and leading technical reviews and mentoring.
Location: Remote; candidates may work from Serbia, Albania, Bosnia and Herzegovina, Montenegro, North Macedonia, Ukraine, Georgia, Argentina, Brazil, Estonia, Latvia, Lithuania, Finland, Romania, Hungary, Slovakia, Slovenia, or the Czech Republic.
Company
hirify.global is a global digital engineering, product development, and technology consulting company headquartered in New York, with more than 1,000 experts across more than 65 countries.
What you will do
Lead end-to-end development of data pipelines, ETL/ELT processes, and batch and streaming solutions with Databricks and Apache Spark.
Design and implement Lakehouse architectures aligned with business and technical requirements.
Collaborate with data scientists, analysts, and engineers to deliver high-performance data products and ML features.
Define coding standards, best practices, performance-tuning strategies, and data governance standards using Delta Lake and Unity Catalog.
Integrate data sources across AWS, Azure, and GCP using native and third-party connectors, and automate infrastructure deployment with Terraform or Databricks CLI.
Lead technical reviews and architecture sessions, mentor less experienced engineers, and ensure solutions are secure, compliant, and scalable.
Requirements
Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
5+ years of experience in data engineering or big data roles.
2+ years of hands-on experience with Databricks, Spark using PySpark or Scala, and Delta Lake.
Strong knowledge of AWS, Azure, or GCP and modern data architectures such as Lakehouse and Data Mesh.
Proficiency in SQL, Python, and distributed data processing.
Experience with CI/CD, Git, and DataOps in a data environment.
Deep understanding of data governance, cataloging, and security concepts.
Experience leading a team or project as a team lead or tech lead.
Excellent written and verbal communication skills in English. Ability to work in a global, multinational company, lead conversations with technical and business representatives, and work independently and as part of an international project team.
Nice to have
Databricks Pro or Architect certification.
Experience with machine learning pipelines and MLOps in Databricks.
Exposure to Kafka or Spark Structured Streaming.
Knowledge of dbt, Airflow, or similar transformation and orchestration tools.
Culture & Benefits
100% remote opportunity with a flexible work environment; office, remote, or hybrid arrangements may be available depending on preferences and manager approval.
Competitive salary and benefits that vary by location and are confirmed during the interview process.
Paid time off, including holidays, vacation, and sick leave.
Professional growth and career advancement opportunities.
Collaborative and innovative environment with global project exposure.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →