Data Engineer with DataBricks

TL;DR

Data Engineer (DataBricks): Design, build, and maintain ETL processes, transforming raw data into actionable insights with an accent on data quality and integrity. Focus on optimizing large-scale data pipelines and leveraging Azure Databricks for advanced data processing and analytics.

Location: Remote. Bulgaria and Poland only specified as remote locations.

Company

hirify.global is a company that values innovation and teamwork where you contribute to the company's success, not just a single project.

What you will do

• Design, build, and maintain ETL processes, transforming raw data into actionable insights
• Manage and optimize large-scale data pipelines, ensuring data quality and integrity
• Develop and optimize SQL queries for efficient data extraction, transformation, and analysis
• Collaborate with cross-functional teams to understand data requirements and implement effective data solutions
• Utilize Python and PySpark for data engineering tasks, including scripting and automation
• Leverage Azure Databricks for advanced data processing and analytics

Requirements

• Proven experience as a Data Engineer in a professional, production environment
• Strong programming skills in Python and solid understanding of ETL processes
• Advanced proficiency in SQL and experience working with large datasets
• Hands-on experience with Azure Databricks and Azure Data Factory (ADF)
• Solid understanding of data modeling, data warehousing concepts, and performance tuning
• Strong expertise in Databricks, including Delta Tables and Delta Live Tables

Nice to have

• Experience with data governance and data cataloging tools
• Familiarity with CI/CD practices and version control systems (Git)
• Understanding of data security and privacy best practices
• Experience with additional cloud services or platforms

Culture & Benefits

• As per the laws of your country vacation time.
• Health insurance policy for you and your loved ones.
• 10 days sick pay without a doctor's note, afterwards - as per the laws of your country
• Time off for state holidays according to the official calendar, regardless of the client’s schedule
• Pleasant environment with two large corporate parties and many small get-togethers for colleagues
• Solving technical and everyday problems at work with comfort service