Software Engineer – Data Platforms (Big Data)

TL;DR

Software Engineer – Data Platforms (Big Data): Designing and building scalable engines to process terabytes of TV and advertising data with an accent on data aggregation pipelines and cloud-native deployment. Focus on optimizing Spark/Scala flows, implementing TDD, and scaling infrastructure via Kubernetes on AWS.

Location: Remote by default, but requires occasional on-site presence in Berlin or Cologne, Germany.

Company

smartclip is a data platform specializing in the processing and refinement of massive volumes of TV and advertising data.

What you will do

• Design and implement technical solutions for Big Data applications in an agile, high-performance environment.
• Develop and refine data aggregation pipelines for TV and advertising data using Spark and Scala.
• Host, manage, and scale cloud-native solutions using Docker and Kubernetes within AWS.
• Drive quality through Test Driven Development (TDD), from unit to complex integration tests.
• Evaluate and integrate new frameworks and tools to maintain a cutting-edge technology stack.

Requirements

• Strong software engineering background with focus on JVM languages (Scala/Java) and/or Python.
• Proven experience with Spark, Hadoop, or similar distributed systems.
• Proficiency with CI/CD, Docker, Kubernetes, and AWS.
• Fluency in both German and English is required.
• Commitment to clean architecture, efficiency, and pragmatic problem-solving.

Nice to have

• Experience with Trino, Flowman, or Delta Lake.
• Passion for open-source software.

Culture & Benefits

• Remote-first culture with high autonomy and ownership over tasks.
• Smart Fridays enabling a 4-day work week.
• 30 days of vacation plus additional days off on December 24th and 31st.
• Mobility support including the Germany ticket and JobRad.
• Comprehensive health and mental health support, corporate benefits, and RTL+ access.