TL;DR
Data Engineer (Data Science/ML): Designing, developing, and maintaining end-to-end data ingestion pipelines supporting batch, near real-time, streaming, and event-driven patterns with an accent on robust software engineering practices and observability. Focus on building production-grade data pipelines, implementing CI/CD automation, and operational ownership in a hybrid work setup in Portugal.
Location: Hybrid in Porto or Lisboa, Portugal
Company
hirify.global is a Swiss consulting firm focused on strategic, technological, and organizational challenges, supporting employee development and career progression.
What you will do
- Design, develop, and maintain data ingestion pipelines for batch, near real-time, streaming, and event-driven data.
- Build and maintain connectors for APIs, databases, filesystems, and SaaS platforms.
- Implement data quality checks, validation rules, and data contracts.
- Apply software engineering best practices in Python including modular design, testing, and documentation.
- Implement CI/CD pipelines and automation using Docker and GitHub Actions.
- Ensure monitoring, alerting, and dashboards for observability and troubleshooting.
Requirements
- Must have over 5 years of experience as a Data Engineer in production environments
- Fluent English required
- Advanced Python skills with experience in PySpark and Pandas.
- Experience with AWS and Databricks platforms.
- Strong CI/CD and automation skills using Docker and GitHub Actions.
- Experience integrating with APIs including authentication and error handling.
- Observability practices including logging, metrics, and alerting.
- Strong Git discipline with daily commits and code reviews.
Culture & Benefits
- Supportive environment with training and career opportunities in Switzerland and internationally.
- Climate of trust based on transparency and professionalism.
- Encouragement of innovation blending technology and creativity.
- Commitment to collective responsibility and positive impact.
Будьте осторожны: если вас просят войти в iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →