5 часов назад
Senior Data Engineer (Remote)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (GCP/Apache Spark): Building and maintaining batch and streaming ETL pipelines and cloud-based data ecosystems for trusted, reusable data products with an accent on Apache Airflow, Spark, Python, Scala, and GCP services. Focus on real-time ingestion, data model optimization, automated testing, data compliance, and integrating GenAI tools for data quality and analytics.
Location: Remote; Corporate Offices (0900)
Company
develops retail offerings and customer-facing products through collaboration across design, product, engineering, data science, and full-stack engineering.
What you will do
- Develop, automate, and maintain batch and streaming ETL pipelines with Apache Airflow, Apache Spark, Python, and Scala.
- Build and manage cloud-based data ecosystems on GCP, including BigQuery, Bigtable, Dataproc, Pub/Sub, Cloud Storage, IAM, and VPC.
- Design and optimize SQL and NoSQL data models for data lakes and warehouses using BigQuery, MongoDB, and Snowflake.
- Implement real-time ingestion with Kafka Connect and process streaming data with Spark Streaming, Apache Flink, or similar technologies.
- Lead technical initiatives, establish engineering standards, and collaborate with product managers, data scientists, designers, and full-stack engineers.
- Improve data performance, scalability, cost efficiency, observability, and reliability across the data platform.
Requirements
- 4+ years of software development experience.
- Strong understanding of application design patterns, event-driven architecture, databases, schemas, and testing strategies.
- In-depth experience with continuous integration, continuous deployment, and test-driven development.
- Experience with large-scale application troubleshooting and performance tuning.
- Exposure to a major cloud platform such as GCP, AWS, or Azure.
- Bachelor's degree or equivalent in MIS, Computer Science, or a related field is preferred.
Nice to have
- Experience with Extreme Programming practices.
- Experience applying data mesh and data-as-a-product principles.
- Experience integrating OpenAI, Gemini, or Anthropic LLMs into data quality and analytics workflows.
Culture & Benefits
- Remote full-time work arrangement.
- Collaboration with cross-functional product engineering teams.
- Use of user-centric development, experimentation, critical thinking, and industry best practices.
- Work in a fast-paced environment with regular team discussions, ceremonies, and feedback.
- Compliance with data protection standards including GDPR, PCI DSS, SOX, and CCPA.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
15 часов назад
Staff Software Engineer (Data Engineering)
126 092 - 151 560CAD
6 часов назад
Data Engineering Manager, Commercial US
148 500 - 214 500$
8 часов назад
Lead Engineer- Data
5 часов назад
Data Software Engineer III - ML Ops
108 160 - 162 240$
4 часа назад
Data Engineer II (Fintech)
129 000 - 156 000$
16 часов назад