Senior Data Engineer (Big Data, Banking)

TL;DR

Senior Data Engineer (Big Data, Banking): Designing and developing complex data pipelines for a banking project with an accent on data ingestion, performance optimization, and secure data solutions. Focus on leveraging the Cloudera Hadoop stack, Spark, Impala, and contributing to the platform's long-term data strategy.

Location: Hybrid in Prague, Czechia

Salary: 85,000 – 90,000 CZK per year

Company

hirify.global is an IT consultancy firm that helps startups and corporations create and deliver innovative software solutions, including AI, ML, and BI, across various industries like Telecom, Energy, Banking, and E-commerce.

What you will do

• Design and develop custom data pipelines for batch and near-real-time processing, ensuring data ingestion from diverse sources.
• Optimize data performance using Avro and Parquet on HDFS, and debug Spark and Impala sessions.
• Design and implement secure data solutions following security-by-design principles.
• Monitor Big Data applications using Kafka, InfluxDB, and Grafana.
• Perform DevOps tasks including CI/CD with Jenkins and version control with Git/SVN.
• Create comprehensive documentation, standardize procedures, mentor junior colleagues, and contribute to the platform's long-term data strategy.

Requirements

• Strong experience with the Cloudera Hadoop stack, including HDFS, Hive Metastore, Impala, and Spark.
• Advanced SQL skills and scripting experience in Bash, Python, and PowerShell.
• Experience in Linux production environments.
• Familiarity with Airflow, Informatica, and NiFi.
• Proven ability to independently design complex data solutions.
• Communicative, systematic, and responsible with strong team collaboration skills.

Nice to have

• Experience with Databricks – Data Engineering.
• Exposure to Azure Data Stack (Data Factory, ADLS, Synapse, etc.).