обновлено 6 часов назад
Data Engineer (Spark)
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Engineer (Spark) (Python/Scala, Azure/AWS): Designing and developing data solutions, ETLs, and scalable pipelines for customized data-powered software projects with an accent on Spark-based large-dataset processing, cloud platforms, and reusable code. Focus on building projects from scratch, implementing CI/CD and automated testing, and delivering reliable pipelines with minimal supervision.
Location: Spain; remote work is available, with optional office work.
Company
is a technical consultancy delivering customized software, data, AI, blockchain, and training projects for clients.
What you will do
- Design and develop data solutions for challenging client projects.
- Develop projects from scratch with minimal supervision and strong team collaboration.
- Develop ETLs using Spark with Python or Scala.
- Work on cloud-based projects using Azure and AWS.
- Build scalable data pipelines using a variety of technologies.
- Promote clean, reusable code and engineering best practices.
Requirements
- At least 4 years of experience in data engineering.
- Strong Python or Scala and Spark experience processing large datasets.
- Solid experience with Azure or AWS cloud platforms.
- Hands-on experience building data pipelines and CI/CD workflows.
- Experience with unit, integration, and other types of testing.
- Knowledge of SQL and NoSQL databases; strong team-player mindset.
Nice to have
- Experience with Databricks, Snowflake, or Microsoft Fabric.
- Infrastructure as Code experience.
- Fluent English.
Culture & Benefits
- Remote work with the option to work from an office and a flexible schedule of 35 hours per week.
- Agile, multidisciplinary, and collaborative teams with ownership of projects.
- Health insurance, with dental services available with co-payment.
- Training or equipment budget and free Microsoft certifications.
- English lessons, birthday day off, and a monthly home electricity and Internet allowance.
- Flexible compensation for restaurant, transport, and childcare, plus sports discounts and team events.
Hiring process
- Phone screen.
- Two interviews with the team.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →