Data Engineer (Databricks)

TL;DR

Data Engineer (Databricks): Design and optimize scalable streaming and batch data pipelines using Apache Spark on Databricks with an accent on modern Data Lakehouse architecture and performance optimization. Focus on building CI/CD pipelines, supporting AI/ML workflows, and leveraging advanced Databricks features.

Location: Hybrid in Vilnius, Lithuania

Salary: €4,512–€5,308

Company

hirify.global is a global technology and consulting corporation specializing in hybrid cloud, AI, and business transformation services.

What you will do

• Design and build streaming and batch data pipelines using Apache Spark on Databricks
• Optimize data performance with Delta Lake, Z-ordering, and liquid clustering
• Develop and maintain modern Data Lakehouse architecture with PySpark and SQL
• Leverage latest Databricks features including Structured Streaming, Lakeflow, Unity Catalog, and DBSQL
• Support AI/ML workflows and implement CI/CD pipelines using GitHub Actions or Azure DevOps

Requirements

• Location: Hybrid work arrangement in Vilnius, Lithuania
• English: B2 level or higher required
• Bachelor's degree in relevant field; Master's preferred
• 3+ years experience in data/software engineering with large-scale distributed systems
• Strong Python skills including OOP and testing frameworks, experience with PySpark and SQLGlot
• Familiarity with cloud platforms (Azure preferred) and Databricks

Nice to have

• Certifications in Databricks or Azure Data Engineering
• Experience with real-time data processing technologies like Kafka and Spark Streaming
• Exposure to AI/ML workflows and tools such as MLflow

Culture & Benefits

• Flexible working patterns available upon discussion
• Supportive environment encouraging continuous learning and experimentation
• Focus on collaboration, trust, and personal responsibility
• Commitment to diversity, equity, and inclusion