aisqlkafkahadoopdata modelingscalasparkhivedata pipelinescloud data engineering
Вакансия из Hirify Global, списка международных tech-компаний Для мэтча и отклика нужен Plus
Пожаловаться
Зарплата и рынок
развернуть
$157к-251к/год
$170к$210кмедиана$240к
По похожим ролям (49) ~ $210к/год
На СНГ рынке: $3.8к/мес ($3к - $4.3к)
88
Хорошая вакансия
развернуть
В Company hidden чётко описана роль ведущего инженера по данным с техническим лидерством, наставничеством и работой с крупными платёжными системами; обязательные дни в офисе и поездки стоит учитывать.
Обязательный офис
Актуальный стек
Полный цикл ответственности
Финтех мирового масштаба
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Подключить Plus
Описание вакансии
Текст:
Hirify AI/Оригинал
TL;DR
Staff Data Engineer (Apache Spark/Scala): Designing and operating large-scale batch and streaming data systems, pipelines, and secure data services with an accent on distributed processing, data quality, and production reliability. Focus on optimizing Spark workloads, building high-volume pipelines, applying AI-assisted development, and meeting security, privacy, governance, and regulatory requirements.
Location: US - Foster City, CA; at least 3 days per week in the office; 5–10% travel required
Salary: $156,800–$251,100 USD per year, with potential bonus, equity, and sales incentive payments where applicable.
Company
hirify.global is a global payments technology company facilitating transactions between consumers, merchants, financial institutions, and governments across more than 200 countries and territories.
What you will do
Design, implement, and improve large-scale data systems, architectures, pipelines, and services.
Develop, debug, and optimize distributed data workloads using Apache Spark, Scala, Hadoop, Hive, and Kafka.
Build and operate high-volume batch and streaming pipelines with orchestration, incremental processing, historical backfills, and data quality controls.
Deliver curated datasets, reusable data products, and secure API-based data services for enterprise use.
Own pipelines through deployment, monitoring, troubleshooting, documentation, technical debt reduction, and operational improvement.
Mentor engineers and lead cross-functional technical delivery while supporting security, privacy, governance, and regulatory requirements.
Requirements
At least 5 years of relevant experience with a Bachelor’s degree, at least 2 years with an advanced degree, no experience with a PhD, or 8+ years of relevant experience.
Strong hands-on Apache Spark and Scala expertise, including Hadoop, Hive, Kafka, distributed storage, debugging, and performance tuning.
Experience building complex batch and streaming pipelines, using SQL and data modeling, orchestration, incremental processing, historical backfills, and automated data quality controls with agentic solutions.
Ability to write maintainable code and apply code reviews, automated testing, CI/CD, secure coding, monitoring, and troubleshooting practices.
Ability to work with emerging technologies, including generative AI tools such as ChatGPT and Microsoft Copilot, and validate generated code for quality and security.
Ability to meet data governance, security, privacy, access, retention, and regulatory requirements.
Nice to have
Experience delivering scalable data services, curated datasets, reusable data products, cloud processing, and secure API-based access.
Experience with AI-assisted development tools, coding agents, intelligent automation, and validation against engineering and security standards.
Experience with unit, integration, and end-to-end testing, CI/CD, containerization, orchestration tools, production monitoring, and reliability optimization.
Cloud data engineering experience with AWS preferred, or Azure or Google Cloud, including cloud-native storage, processing, security, observability, and cost optimization.
Knowledge of Databricks, Clean Rooms, Delta Lake, Unity Catalog, Apache Iceberg, lakehouse engineering, workflow orchestration, and storage-compute separation.
Experience with Redis, NoSQL, RDBMS, real-time systems, production deployments, mentoring junior engineers, and technical documentation.
Culture & Benefits
Full-time office-based employment with working hours varying according to department needs.
Benefits may include medical, dental, vision, 401(k), FSA/HSA, life insurance, paid time off, and a wellness program.
Potential bonus and equity eligibility.
Будьте осторожны
Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →