Назад
Company hidden
3 дня назад

Staff Data Engineer

156 800 - 251 100$
Формат работы
hybrid
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Staff Data Engineer (Apache Spark/Scala): Designing and operating large-scale batch and streaming data systems, pipelines, and secure data services with an accent on distributed processing, data quality, and production reliability. Focus on optimizing Spark workloads, building high-volume pipelines, applying AI-assisted development, and meeting security, privacy, governance, and regulatory requirements.

Location: US - Foster City, CA; at least 3 days per week in the office; 5–10% travel required

Salary: $156,800–$251,100 USD per year, with potential bonus, equity, and sales incentive payments where applicable.

Company

hirify.global is a global payments technology company facilitating transactions between consumers, merchants, financial institutions, and governments across more than 200 countries and territories.

What you will do

  • Design, implement, and improve large-scale data systems, architectures, pipelines, and services.
  • Develop, debug, and optimize distributed data workloads using Apache Spark, Scala, Hadoop, Hive, and Kafka.
  • Build and operate high-volume batch and streaming pipelines with orchestration, incremental processing, historical backfills, and data quality controls.
  • Deliver curated datasets, reusable data products, and secure API-based data services for enterprise use.
  • Own pipelines through deployment, monitoring, troubleshooting, documentation, technical debt reduction, and operational improvement.
  • Mentor engineers and lead cross-functional technical delivery while supporting security, privacy, governance, and regulatory requirements.

Requirements

  • At least 5 years of relevant experience with a Bachelor’s degree, at least 2 years with an advanced degree, no experience with a PhD, or 8+ years of relevant experience.
  • Strong hands-on Apache Spark and Scala expertise, including Hadoop, Hive, Kafka, distributed storage, debugging, and performance tuning.
  • Experience building complex batch and streaming pipelines, using SQL and data modeling, orchestration, incremental processing, historical backfills, and automated data quality controls with agentic solutions.
  • Ability to write maintainable code and apply code reviews, automated testing, CI/CD, secure coding, monitoring, and troubleshooting practices.
  • Ability to work with emerging technologies, including generative AI tools such as ChatGPT and Microsoft Copilot, and validate generated code for quality and security.
  • Ability to meet data governance, security, privacy, access, retention, and regulatory requirements.

Nice to have

  • Experience delivering scalable data services, curated datasets, reusable data products, cloud processing, and secure API-based access.
  • Experience with AI-assisted development tools, coding agents, intelligent automation, and validation against engineering and security standards.
  • Experience with unit, integration, and end-to-end testing, CI/CD, containerization, orchestration tools, production monitoring, and reliability optimization.
  • Cloud data engineering experience with AWS preferred, or Azure or Google Cloud, including cloud-native storage, processing, security, observability, and cost optimization.
  • Knowledge of Databricks, Clean Rooms, Delta Lake, Unity Catalog, Apache Iceberg, lakehouse engineering, workflow orchestration, and storage-compute separation.
  • Experience with Redis, NoSQL, RDBMS, real-time systems, production deployments, mentoring junior engineers, and technical documentation.

Culture & Benefits

  • Full-time office-based employment with working hours varying according to department needs.
  • Benefits may include medical, dental, vision, 401(k), FSA/HSA, life insurance, paid time off, and a wellness program.
  • Potential bonus and equity eligibility.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →