Вакансия из Hirify Global, списка международных tech-компаний Для мэтча и отклика нужен Plus
Пожаловаться
Зарплата и рынок
ЗП не указана
На похожих ролях по рынку
$160к$175кмедиана$200к
49 в выборке
На СНГ рынке: $3.7к/мес ($3к - $4.3к)
85
Крутая вакансия
развернуть
Сильная позиция Senior-уровня с современным стеком на GCP и интересным фокусом на GenAI и Data Mesh. Единственный минус - отсутствие вилки в описании, но технический уровень задач очень достойный для ритейл-гиганта.
Кликните для подробной информации
Зарплата не указанаАктуальный стекРабота с GenAIПонятный scope
Оценка от Hirify AI
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Подключить Plus
Описание вакансии
Текст:
Hirify AI/Оригинал
TL;DR
Senior Data Engineer (Remote) (GCP/Big Data): Building and maintaining batch and streaming ETL pipelines and cloud-based data ecosystems with an accent on Apache Airflow, Spark, Python, Scala, BigQuery, and real-time ingestion. Focus on optimizing data performance and cost, applying TDD and data-mesh principles, ensuring regulatory compliance, and integrating GenAI tools into data quality and analytics.
Develops retail offerings and customer-facing applications through product engineering and data-driven technology.
What you will do
Lead development of robust, observable, measurable applications using user-centric practices and extreme programming principles.
Develop, automate, and maintain batch and streaming ETL pipelines with Apache Airflow, Apache Spark, Python, and Scala.
Build and manage GCP data ecosystems using BigQuery, Bigtable, Dataproc, Pub/Sub, Cloud Storage, IAM, and VPC.
Design and optimize SQL and NoSQL data models, complex transformations, analytics queries, and data performance across lakes and warehouses.
Implement real-time ingestion with Kafka Connect and process streaming data with Spark Streaming, Apache Flink, or similar technologies.
Lead technical initiatives and standards while collaborating with designers, product managers, engineers, data scientists, and stakeholders.
Requirements
4+ years of experience in software development.
Understanding of application design patterns, event-driven architecture, databases, schemas, and testing strategies.
In-depth knowledge and experience with continuous integration, continuous deployment, and test-driven development.
Experience with Apache Airflow, Apache Spark, Python, Scala, SQL, and data pipeline development.
Experience designing data lakes, warehouses, SQL and NoSQL models, including BigQuery, MongoDB, or Snowflake.
Experience with real-time data ingestion and streaming technologies such as Kafka Connect, Spark Streaming, or Apache Flink.
Ability to apply data mesh and data-as-a-product principles and ensure compliance with GDPR, PCI DSS, SOX, CCPA, PCI, and PII data standards.
Ability to integrate GenAI tools including OpenAI, Gemini, and Anthropic LLMs for data quality and analytics enhancement.
Ability to collaborate across product, engineering, data science, and stakeholder groups and lead technical initiatives.
Nice to have
Bachelor's degree or equivalent in MIS, Computer Science, or a related field.
Experience with large-scale application troubleshooting and performance tuning.
Exposure to major cloud platforms including GCP, AWS, or Azure.
Familiarity and experience with Extreme Programming.
Culture & Benefits
Remote work arrangement associated with hirify.global corporate offices.
Collaboration with design, product, engineering, data science, and stakeholder teams.
Emphasis on empathetic, actionable feedback, shared context, and team ceremonies.
Support for continuous learning through research into technology trends and practices.
Company training programs and reasonable accommodations for individuals with disabilities.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →