22 дня назад
Ab Initio Developer (GCP)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Ab Initio Developer (GCP): Designing and modernizing enterprise ETL pipelines for home lending data platforms across legacy environments and Google Cloud Platform, with an accent on Ab Initio development, Python/PySpark processing, and BigQuery optimization. Focus on migrating Teradata workloads to cloud-native architectures, implementing data quality and governance controls, and building reliable near real-time data processing systems.
Location: Charlotte, North Carolina, United States; hybrid work required
Company
provides staffing and technology consulting services for enterprise clients.
What you will do
- Design, develop, and maintain scalable batch and near real-time data pipelines using Ab Initio, Python, PySpark, PL/SQL, and SQL.
- Build and optimize BigQuery datasets, transformations, and data models, including partitioning, clustering, and query performance improvements.
- Migrate legacy Teradata and Ab Initio solutions to Google Cloud Platform, supporting validation, reconciliation, parallel processing, and production cutovers.
- Modernize workflow orchestration from Autosys to Cloud Composer with Apache Airflow and implement metadata management through Dataplex.
- Monitor production pipelines, troubleshoot failures, perform root cause analysis, and improve reliability, performance, security, and scalability.
- Collaborate with product owners, architects, analysts, and engineers while documenting data dictionaries, runbooks, reconciliation processes, and technical specifications.
Requirements
- 4+ years of professional data engineering experience and enterprise ETL development with Ab Initio, including graph development, Psets, and performance tuning.
- 4+ years of experience with PL/SQL and SQL, including complex query development, optimization, and troubleshooting.
- 3+ years of Python programming with hands-on PySpark development.
- Experience with Oracle, Teradata, and/or Google BigQuery, plus data warehousing, dimensional modeling, ETL architecture, and data integration.
- Strong understanding of enterprise data governance, metadata management, data lifecycle management, and scalable batch or near real-time processing.
- Required: experience using AI-assisted coding tools such as GitHub Copilot or Devin while maintaining code reviews, testing, and secure coding standards.
Nice to have
- Experience with Google Cloud Platform services including BigQuery, Dataplex, and Cloud Composer.
- Experience migrating on-premises enterprise data platforms to cloud-native architectures.
- Experience with Informatica Data Quality, Autosys, and regulated data engineering environments.
- Experience in Agile/Scrum and financial services or mortgage/lending.
Culture & Benefits
- Work on enterprise-scale data modernization within a home lending data and insights organization.
- Collaborate across product, architecture, analytics, and engineering functions.
- Support production-grade systems with an emphasis on security, data quality, operational excellence, and continuous improvement.
- 24-month contract engagement in a hybrid work environment.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
2 дня назад
Principal Backend Data Engineer (Python/BigQuery/dbt)
240 000 - 260 000$
8 часов назад
Software Engineer 4 - Contingent (Java/Python)
65 - 75$
7 дней назад
Senior Software Engineer, Data Platform (AI)
170 000 - 220 000$
3 дня назад
Lead Data Engineer (GCP)
130 000 - 170 000$
2 дня назад
Backend and Data Engineer (Python/BigQuery/dbt)
240 000 - 260 000$
7 дней назад