5 дней назад
Staff Platform Engineer (Big Data)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Staff Platform Engineer (Big Data): Designing, implementing, and managing large-scale Big Data infrastructure with an accent on Hadoop, Spark, storage systems, security, governance, and platform performance. Focus on optimizing clusters and streaming/batch pipelines, deploying AI/ML infrastructure, scaling search workloads, and leading engineering teams.
Location: Singapore, Singapore; on-site. Only Singapore Citizens will be considered.
Company
CSIT develops products and technologies supporting Singapore’s national security operations, including counter-terrorism and computer network defence.
What you will do
- Design, implement, and manage Big Data infrastructure based on Hadoop, Spark, NoSQL databases, and data lakes.
- Monitor, troubleshoot, and optimize Big Data clusters, including job scheduling and resource allocation.
- Design and implement storage solutions using HDFS, S3, and other object storage systems.
- Secure and govern the platform through access controls, encryption, authentication, authorization, and regular security audits.
- Collaborate with data engineers and data scientists to optimize application performance and provide platform guidance.
- Forecast capacity and manage the procurement and deployment of new infrastructure.
Requirements
- Bachelor’s degree in Computer Science, Engineering, or a related field.
- At least 8 years of experience managing Big Data platforms and experience leading engineering teams.
- Experience with Spark, Iceberg, Trino, Elastic Stack, NiFi, Kafka, and Airflow.
- Expertise in streaming and batch pipelines, data warehouse architecture, and AI/ML infrastructure.
- Experience with S3, NFS, SMB, HDFS, Kubernetes, Git, networking, and infrastructure automation.
- Knowledge of SSL/TLS, encryption at rest, OIDC/OAuth2, firewall configuration, DNS, routing, and subnetting.
Nice to have
- Hadoop or Spark certifications.
- Experience managing physical and virtual infrastructures.
- Experience deploying and scaling LLM-based and agentic AI/ML applications.
Culture & Benefits
- Purposeful work supporting national security.
- Modern technologies and engineering practices.
- Strong engineering culture and work-life balance.
- Focus on engineering and operational excellence.
- Opportunities to innovate and grow with experienced engineers.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
11 дней назад
Senior Software Engineer, Platform (AI Infrastructure)
11 дней назад
Engineering Manager, Platform (AI Platform)
12 дней назад
Senior DevOps Engineer (Streaming Platform)
7 дней назад
Senior Staff, Platform Engineer, DevOps (Kubernetes)
9 дней назад