Senior Data Platform Engineer (Java/Spark)

TL;DR

Senior Data Platform Engineer (Java/Spark): Building and optimizing hyper-scale data platforms and pipelines for a global cybersecurity company with an accent on processing petabytes of data for analytics and machine learning. Focus on designing, developing, and owning a new graph database within a distributed microservices architecture on AWS.

Location: Hybrid role based in London, United Kingdom. hirify.global is not in a position to provide relocation for this role.

Company

hirify.global is a global leader in cybersecurity, protecting organizations with the world’s most advanced AI-native platform that processes almost 3 trillion events per day.

What you will do

• Write highly fault-tolerant Java code within Apache Spark to produce platform products.
• Design, develop, and maintain ultra-high-scale data platforms that process petabytes of data.
• Participate in technical reviews and help develop new features and enhance stability.
• Continually improve the efficiency and reduce latency of high-performance services.
• Research and implement new ways for efficient data querying and extraction for internal and external customers.

Requirements

• 10+ years' experience combined between backend/cloud development and data platform engineering roles.
• 5+ years of experience building data platform products or features with Apache Spark, Flink or Iceberg, or comparable tools.
• 5+ years of experience programming with Java, Scala, or Kotlin.
• Proven experience owning robust feature/product design end-to-end, especially with vaguely defined problem statements.
• Proven expertise with algorithms, distributed systems design, and the software development lifecycle.
• Experience building large scale data/event pipelines.
• Expertise designing solutions with relational SQL and NoSQL databases, including Postgres/MySQL, Cassandra, DynamoDB.
• Good test driven development discipline.
• Reasonable proficiency with Linux administration tools.

Nice to have

• Go
• Pinot or other time-series/OLAP-style database
• Iceberg
• Kubernetes
• Jenkins
• Parquet
• Protocol Buffers/GRPC

Culture & Benefits

• Market leader in compensation and equity awards.
• Comprehensive physical and mental wellness programs.
• Competitive vacation and holidays for recharge.
• Paid parental and adoption leaves.
• Professional development opportunities for all employees.
• Employee Networks, geographic neighborhood groups, and volunteer opportunities.
• Vibrant office culture with world class amenities.