Data Flow Engineer

TL;DR

Data Flow Engineer (Apache NiFi/Kafka/CDC): Design, implement, test, and maintain complex data flows in Cloudera DataFlow (Apache NiFi) with an accent on CDC-based real-time/near-real-time pipelines, schema/governance management, and reliable integrations. Focus on building NiFi-centric ingestion/transform/enrich/routing/egress workflows, integrating with external systems, and troubleshooting performance and reliability in CDP ecosystems.

Location: Warsaw, Masovian Voivodeship, Poland (On-site)

Company

Quento (ICT arm of hirify.global) delivers AI, Digital Engineering, Cloud, and Cybersecurity solutions for clients worldwide.

What you will do

• Design, implement, test, and maintain complex data flows in Cloudera DataFlow (Apache NiFi), including ingest, transform, enrich, route, and egress.
• Build and optimize CDC-based pipelines (real-time/near-real-time) using NiFi, Kafka, Debezium, and SQL CDC connectors.
• Integrate external systems via REST API, JDBC, Kafka, and other protocols.
• Manage data schemas (Avro), metadata, and lineage using Apache Atlas; configure security/governance with Ranger policies.
• Monitor, alert, and troubleshoot performance and reliability of data pipelines; maintain SOPs, documentation, and runbooks.
• Participate in CDP/NiFi/Kafka upgrades and migrations and collaborate with data engineers, architects, and business stakeholders on requirements and architecture.

Requirements

• Minimum 8 years of IT professional experience and minimum 6 years in a similar position.
• Hands-on daily experience with Apache NiFi (preferably in a CDP environment) including design, deployment, monitoring, and troubleshooting of advanced flows (min. 2–3 years hands-on).
• Documented experience delivering at least one large integration project using NiFi as the central tool (API calling, DB integrations, transformations, data routing and delivery).
• Practical experience with CDC pipelines to/from relational databases and building CDC-based data flows using NiFi connectors/processes and SQL Builder.
• Practical knowledge of Apache Iceberg (table creation/management, schema evolution, partitioning) and governance/catalog in CDP: Apache Atlas (metadata/lineage/tagging) and Apache Ranger (security policies/authorization).
• English: B2 (CV submitted in English) and at least one relevant Cloudera certification (NiFi developer or Data Flow/CFM-related) or equivalent.

Culture & Benefits

• On-site role in Poland (Warsaw area).
• Work focused on compliance with regulatory requirements and support for the Group Anti-Bribery and Corruption Policy.
• CV submission and communication expected in English.