Data Engineer (Python/PySpark)

TL;DR

Data Engineer (Python/PySpark): Designing and creating data ingestion pipelines based on the Databricks Platform with an accent on preparing data transformations using Python and PySpark. Focus on developing robust code and leveraging knowledge of cloud platforms like AWS.

Location: Remote (global) or office work.

What you will do

• Design and create data ingestion pipelines based on the Databricks Platform.
• Prepare data transformations with Python and PySpark library.

Requirements

• 2+ years of experience in Data Engineering.
• Familiarity with the Databricks platform.
• Ability to write robust code with Python.
• Proficiency with Spark (PySpark).
• Knowledge of cloud platforms, specifically AWS.

Nice to have

• Knowledge of Lakehouse concept including experience using Delta Lake optimized storage layer.

Culture & Benefits

• Competitive compensation.
• Flexible working hours.
• Healthcare benefits: medical insurance and paid sick leave.
• Continuous education, mentoring, and professional development programs.
• Certifications paid by the company.
• Work with a team with excellent tech expertise.