Senior Data Engineer (Databricks)

TL;DR

Senior Data Engineer (Databricks): Working with fast-paced innovative companies, leveraging Databricks as the key driver of their transformation with an accent on ETL/ELT, Data Warehousing and Distributed Data Processing. Focus on Streaming Data systems, Data Modeling, Data Security & Governance and BI/AI.

Location: Remote

Company

hirify.global is a fast-growing company founded by former Google Cloud leaders, architects, and engineers.

What you will do

• Work with fast-paced innovative companies, leveraging Databricks as the key driver of their transformation.
• Act as a trusted advisor, helping customers along their journey on Databricks.
• Cover a large spectrum of technology topics like ETL/ELT, Data Warehousing, Distributed Data Processing, Streaming Data systems, Data Modeling, Data Security & Governance, and BI/AI.

Requirements

• 5+ years of experience serving in a data engineering capacity
• 2+ years of experience working with Databricks
• Familiarity with the Databricks tech stack related to data engineering: notebooks, clusters, jobs, workflows, serverless sql, unity catalog, repos, dashboards, DLT.
• Experience developing production Spark applications
• Strong skills with Python, PySpark and Spark SQL
• Strong understanding of Delta Lake technology and best practices to apply its capabilities during the data pipeline development lifecycle
• Experience with Spark Structured Streaming and Databricks Delta Live Tables (DLT)
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases

Culture & Benefits

• Fully remote company
• Competitive compensation and benefits