обновлено 1 день назад
Data Engineer (Databricks)
28 000 - 52 000€
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Engineer (Databricks) (C#/.NET, Apache Spark): Designing scalable data architectures and building data pipelines with an accent on Databricks, Apache Spark, ETL optimization, and data quality. Focus on developing .NET applications, implementing CI/CD and advanced monitoring, and improving the reliability of data processing workflows.
Location: Hybrid, Lisbon, Portugal
Salary: €28,000–€52,000 per year
Company
is an IT consulting partner based in Portugal, with 18 years of experience and a focus on helping clients make technology decisions in a fast-moving market.
What you will do
- Develop .NET and C# applications for data engineering use cases.
- Build and maintain data pipelines with Apache Spark and Databricks.
- Design scalable data architectures and optimize ETL processes.
- Use Entity Framework, Dagster, Hangfire, Delta Lake, and AutoLoader in data workflows.
- Apply Python and SQL to develop and manage data solutions.
- Ensure data quality through CI/CD practices and advanced monitoring.
Requirements
- 5+ years of experience in data engineering, with a strong focus on programming.
- Professional experience with .NET and C# application development.
- Experience building data pipelines with Apache Spark and Databricks.
- Proficiency in Entity Framework, Dagster, Hangfire, Delta Lake, AutoLoader, Python, and SQL.
- Ability to design scalable data architectures, optimize ETL processes, and implement data quality practices.
Culture & Benefits
- No-term full-time contract.
- Health insurance and 22 days of paid vacation.
- Four additional paid days annually, including Carnival, Christmas Eve, New Year's Eve, and the employee's birthday.
- Meal allowance on a Coverflex card, referral bonus, discounts, and flexible options.
- Annual training budget and opportunities to work on challenging projects.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →