обновлено 7 дней назад
Senior Data Engineer (AdTech)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (AdTech): Building secure, automated, and scalable GCP data-processing pipelines for high-volume advertising analytics with an accent on Python, Apache Druid, Apache Airflow, data governance, and cloud efficiency. Focus on designing production systems for petabyte-scale data, supporting real-time decisioning, mentoring engineers, and solving complex distributed processing challenges.
Location: Hybrid working in London or Edinburgh, United Kingdom
Company
is an advertising technology company providing an omnichannel demand-side platform that combines telco data, movement patterns, and transaction data for audience analytics and targeting.
What you will do
- Design, build, monitor, and support large-scale data-processing pipelines.
- Build secure, automated, scalable production pipelines on GCP for high-volume data and real-time decisioning.
- Optimize cloud compute, data governance, quality, controls, recovery points, and operational efficiency.
- Explore new data streams and support commercial and technical growth.
- Mentor and pair with engineers to improve team capability and delivery capacity.
- Work closely with Product on fast feature delivery and robust engineering follow-up.
Requirements
- 5+ years of experience delivering robust, performant data pipelines under SLA and commercial constraints.
- Experience architecting, developing, and maintaining Apache Druid and Imply platforms, including DevOps practices and large-scale re-architecture.
- Advanced experience building GCP pipelines with native cloud technologies such as Apache Airflow.
- Strong Python skills for data and computational tasks, including data cleansing, validation, and composition.
- Experience with streaming data, relational and non-relational databases, distributed processing technologies such as Spark, and data-science libraries including pandas, scikit-learn, scipy, numpy, and MLlib.
- Advanced GCP knowledge, strong server-side Linux skills, and professional practices in documentation, testing, assurance, and task management.
Nice to have
- Experience optimizing Spark, Hive, or similar tools.
- Advanced relational database operations, including partitioning and indexing.
- Experience with AWS Athena or Google BigQuery.
- Knowledge of complex algorithms and statistical techniques for large data structures.
- Experience with Python notebooks such as Jupyter, Zeppelin, or Google Datalab.
Culture & Benefits
- Lean Development practices and an environment with significant freedom and ambitious goals.
- Work on high-scale systems processing over 350 GB of data per hour and handling 400,000 decision requests per second.
- Opportunity to work with petabytes of analytical data and complex data-science disciplines.
- Collaboration across Engineering and Product in a growing team with significant technical responsibility.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →