5 дней назад
Senior Data Engineer (GCP)
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (GCP) (Data Pipelines and AI Infrastructure): Designing and maintaining scalable GCP data pipelines and infrastructure that turn operational data into reliable, governed, ML-ready datasets with an accent on streaming and batch processing, data quality, and cloud-native architecture. Focus on optimizing pipeline performance and cost, building production data foundations for agentic AI tooling, and owning monitoring, security, and end-to-end reliability.
Location: Remote, United States
Company
provides commerce-enablement technology and high-volume fulfillment services, including fulfillment, warehousing, transportation, order management, pre- and post-purchase, and warehouse management software.
What you will do
- Design, build, and maintain scalable data pipelines with GCP services including Dataflow, Pub/Sub, Data Stream, Spark, and Cloud Composer.
- Develop data models, schemas, and ETL processes using BigQuery, Cloud SQL, Spark, and Data Studio.
- Translate business requirements into reliable data infrastructure and optimize pipelines for performance, scalability, and cost efficiency.
- Implement data validation, governance, access control, security, monitoring, alerting, troubleshooting, and root cause analysis.
- Prepare and expose governed data for ML and agentic AI use cases.
- Mentor the data team and collaborate with data scientists, analysts, software engineers, SRE, and Infrastructure.
Requirements
- 5+ years of data engineering experience, including at least three years in a cloud environment, preferably GCP.
- Expertise with BigQuery, Dataflow, Pub/Sub, Cloud Composer, Cloud Storage, Cloud Functions, and Cloud SQL.
- Strong SQL skills and hands-on ETL and workflow orchestration experience with Apache Airflow or similar tools.
- Proficiency in Python and/or Spark, with experience in both streaming and batch data pipelines.
- Understanding of data warehousing, large datasets, query optimization, data governance, cloud security, and compliance.
- Understanding of ML concepts and data preparation for ML applications, with interest in agentic AI tooling required.
Nice to have
- Bachelor's degree in computer science or a comparable field, or equivalent experience.
- GCP certification, such as Professional Data Engineer or Cloud Architect.
- Experience with ML infrastructure on GCP, AI Platform, TensorFlow, DevOps/MLOps, Terraform, Kubernetes, or Docker.
- Background in logistics, supply chain, 3PL, or warehouse and fulfillment technology.
- Experience working on a distributed team.
Culture & Benefits
- Work in a cloud-native environment supporting high-volume commerce, fulfillment, and supply chain operations.
- Collaborate across data, software engineering, SRE, Infrastructure, analytics, and AI teams.
- Contribute to a rapidly growing organization scaling its teams and technology platform.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →