Senior Data Engineer (Databricks)

TL;DR

Senior Data Engineer (Databricks/PySpark): Designing, expanding, and optimizing data pipelines and architectures to support cross-functional teams with an accent on scalable ETL workflows and data modeling. Focus on implementing batch and streaming data workflows, optimizing data flows for cost-efficiency, and ensuring high availability of data systems.

Location: Remote (CET Timezone)

Company

hirify.global is a global IT services company with over 25 years of experience providing consultants for financial, healthcare, insurance, and technology sectors.

What you will do

• Design, build, and maintain scalable data pipelines for structured and unstructured data ingestion and transformation.
• Implement batch and streaming data workflows to support real-time and analytical use cases.
• Optimize data flows for performance, cost-efficiency, and maintainability.
• Develop data models supporting business intelligence, analytics, and operational needs.
• Implement data quality checks, monitoring, and validation processes to ensure integrity.
• Design and develop interactive dashboards and reports to provide actionable insights to stakeholders.

Requirements

• Strong experience with Databricks for building scalable data pipelines.
• Hands-on experience with PySpark for distributed data processing.
• Proficiency in SparkSQL for data transformation and analysis.
• Solid understanding of data pipelines and data modelling.
• Graduate degree in Computer Science, Statistics, Informatics, or a quantitative field.

Nice to have

• Experience with Azure cloud services.
• Knowledge of Databricks Dashboards.
• Experience with data visualization tools like Power BI, Tableau, or Looker.
• Experience with CI/CD pipelines for data engineering.
• Knowledge of Microsoft Fabric and Dynamics 365 Finance and Operations.

Culture & Benefits

• Global work environment with a focus on integrity, dedication, and teamwork.
• Opportunities for long-term contracts and permanent career growth.
• Commitment to an equal opportunity workplace free from discrimination and harassment.