4 дня назад
ETL Tester (BigQuery)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
ETL Tester (BigQuery) (GCP data quality): Designing and executing multi-layered tests for complex data engineering pipelines across BigQuery, dbt, Dataflow, Dataproc, Cloud Run, and related GCP services with an accent on integration, end-to-end, regression, and data quality validation. Focus on automating tests in CI/CD, provisioning reproducible environments with infrastructure as code, validating database systems, and monitoring pipeline health at scale.
Location: Pune or Bengaluru, India
Company
AI transformation partner helping enterprises turn complex data and business challenges into measurable outcomes through cloud, data, and artificial intelligence.
What you will do
- Define and maintain testing strategies for GCP data engineering pipelines across Dataflow, Dataproc, Cloud Run, BigQuery, dbt, and related services.
- Develop integration, regression, end-to-end, and data quality tests for ETL/ELT pipelines and database systems.
- Orchestrate pipeline validation through Cloud Composer, Apache Airflow, and scripting while validating intermediate and final outputs.
- Embed automated testing and data quality checks into CI/CD pipelines using Jenkins, GitLab CI, and GitHub Actions.
- Provision reproducible test environments with Terraform or Deployment Manager and monitor pipeline health through logging and observability tools.
- Partner with data engineers and stakeholders, mentor junior QA team members, and improve data quality KPIs and test effectiveness.
Requirements
- 5+ years of QA or software testing experience focused on data pipelines or data warehouses.
- Strong SQL skills for complex data validation queries.
- Hands-on experience with GCP data tools including BigQuery, dbt, Dataflow, Dataproc, Cloud Run, Spanner, AlloyDB, and Cloud SQL.
- Experience with data quality frameworks such as Great Expectations, Soda Core, dbt-utils, and dbt-expectations.
- Practical experience with Python, pytest, API testing, Postman, REST APIs, CI/CD automation, and database test environments.
- Strong communication, mentoring, critical-thinking, and attention-to-detail skills.
Nice to have
- GCP Professional Data Engineer certification.
- Knowledge of Dataplex, Cloud Logging, Elementary Data, data governance, lineage, and compliance validation.
- Experience with enterprise data migration projects or data warehouse modernization.
Culture & Benefits
- Culture focused on innovation, professional growth, collaboration, and shared accountability.
- AI-assisted recruitment tools may be used during sourcing and interviews, with final hiring decisions made by the human Talent Team.
- Visa sponsorship or visa transfer is not available.
- Equal opportunity employment practices apply.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
19 часов назад
Senior Software Test Engineer I (AI)
Akamai
4 дня назад
Senior Software Development Engineer in Test (QA Automation)
7 дней назад
Staff QA Engineer (AI Infrastructure)
7 дней назад
Staff Engineer in Test (Hadoop)
5 дней назад
QA Engineer (AI Testing)
7 дней назад