Назад
Company hidden
обновлено 4 дня назад

Senior Data Engineer (Remote)

Формат работы
remote (только USA)
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Senior Data Engineer (Remote) (GCP/Big Data): Building and maintaining batch and streaming ETL pipelines and cloud-based data ecosystems with an accent on Apache Airflow, Spark, Python, Scala, BigQuery, and real-time ingestion. Focus on optimizing data performance and cost, applying TDD and data-mesh principles, ensuring regulatory compliance, and integrating GenAI tools into data quality and analytics.

Location: Remote; hirify.global Corporate Offices (0900)

Company

Develops retail offerings and customer-facing applications through product engineering and data-driven technology.

What you will do

  • Lead development of robust, observable, measurable applications using user-centric practices and extreme programming principles.
  • Develop, automate, and maintain batch and streaming ETL pipelines with Apache Airflow, Apache Spark, Python, and Scala.
  • Build and manage GCP data ecosystems using BigQuery, Bigtable, Dataproc, Pub/Sub, Cloud Storage, IAM, and VPC.
  • Design and optimize SQL and NoSQL data models, complex transformations, analytics queries, and data performance across lakes and warehouses.
  • Implement real-time ingestion with Kafka Connect and process streaming data with Spark Streaming, Apache Flink, or similar technologies.
  • Lead technical initiatives and standards while collaborating with designers, product managers, engineers, data scientists, and stakeholders.

Requirements

  • 4+ years of experience in software development.
  • Understanding of application design patterns, event-driven architecture, databases, schemas, and testing strategies.
  • In-depth knowledge and experience with continuous integration, continuous deployment, and test-driven development.
  • Experience with Apache Airflow, Apache Spark, Python, Scala, SQL, and data pipeline development.
  • Experience designing data lakes, warehouses, SQL and NoSQL models, including BigQuery, MongoDB, or Snowflake.
  • Experience with real-time data ingestion and streaming technologies such as Kafka Connect, Spark Streaming, or Apache Flink.
  • Ability to apply data mesh and data-as-a-product principles and ensure compliance with GDPR, PCI DSS, SOX, CCPA, PCI, and PII data standards.
  • Ability to integrate GenAI tools including OpenAI, Gemini, and Anthropic LLMs for data quality and analytics enhancement.
  • Ability to collaborate across product, engineering, data science, and stakeholder groups and lead technical initiatives.

Nice to have

  • Bachelor's degree or equivalent in MIS, Computer Science, or a related field.
  • Experience with large-scale application troubleshooting and performance tuning.
  • Exposure to major cloud platforms including GCP, AWS, or Azure.
  • Familiarity and experience with Extreme Programming.

Culture & Benefits

  • Remote work arrangement associated with hirify.global corporate offices.
  • Collaboration with design, product, engineering, data science, and stakeholder teams.
  • Emphasis on empathetic, actionable feedback, shared context, and team ceremonies.
  • Support for continuous learning through research into technology trends and practices.
  • Company training programs and reasonable accommodations for individuals with disabilities.

Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →