Sr. Software Engineer - Data Infrastructure (Cybersecurity)

TL;DR

Sr. Software Engineer - Data Infrastructure (Cybersecurity): Building and operating a hyper-scale data lake for breach prevention and threat hunting with an accent on distributed data processing and cloud-native infrastructure. Focus on architecting Flink, Spark, and Ray platforms on Kubernetes to handle petabyte-scale data across multi-cloud environments.

Location: Must be a resident of the NYC Metro area or New Jersey. Currently entirely remote, but expected to transition to hybrid (2-3 days/week in Manhattan office) within 18-24 months.

Salary: $140,000 - $215,000 per year

Company

Global leader in cybersecurity providing an AI-native platform designed to stop breaches and protect modern organizations.

What you will do

• Build and manage large-scale distributed data processing systems using Flink and Spark on Kubernetes.
• Ensure availability, reliability, and security of the big data ecosystem across AWS, GCP, and OCI.
• Design and own APIs, automation, and cluster health dashboards.
• Deploy and manage DevOps tools including Terraform, Chef, Ansible, and CI/CD pipelines.
• Collaborate with engineers and data scientists to optimize query systems like Trino and Presto.

Requirements

• Expert-level experience with Spark and/or Flink on Kubernetes.
• Strong proficiency in Java, Kotlin, Scala, or Go.
• Deep understanding of distributed systems including Iceberg, Pinot, Hive, and Kafka.
• Experience with AWS, Terraform, S3, or MinIO.
• Must be based in the NYC Metro area or New Jersey.
• Ability to pass additional government-required background and fingerprint checks.

Nice to have

• Contributions to open-source projects such as Spark or Flink.
• Experience with real-time data streaming and event-driven architectures.
• Background in site reliability engineering (SRE) or DevOps practices.
• Experience in cybersecurity or high-stakes production environments.
• Advanced degree in Computer Science or a related field.

Culture & Benefits

• Market-leading compensation and equity awards.
• Comprehensive physical and mental wellness programs.
• Competitive vacation, holidays, and paid parental/adoption leaves.
• Professional development opportunities available for all employees.
• Inclusive environment with Employee Networks and geographic neighborhood groups.