2 дня назад
Data Architect (Hadoop/ML/AI/ETL)
91 000 - 202 800$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Architect (Hadoop/ML/AI/ETL): Designing enterprise data movement controls, reconciliation pipelines, catalogs, query federation, and lineage across on-premises warehouses, Hadoop, and Lakehouse environments with an accent on governance, auditability, security, and high-throughput data architecture. Focus on integrating Control-M and Apache Airflow, architecting Apache Polaris and Trino platforms, modernizing Hadoop workloads, and applying AI concepts to pipeline observability and data quality.
Location: In-office in Pittsburgh, PA; Strongsville, OH; or Dallas, TX
Salary: $91,000–$202,800 per year, plus incentive eligibility
Company
is a large financial services organization focused on customer solutions, enterprise risk management, and technology-enabled banking services.
What you will do
- Design enterprise-wide data movement controls, reconciliation frameworks, checksum validation, threshold alerting, and schema evolution tracking.
- Define orchestration standards connecting Control-M batch workflows with Apache Airflow DAGs.
- Architect Apache Polaris REST catalog governance for Apache Iceberg, including RBAC and credential scoping.
- Implement and tune Trino across private infrastructure to federate queries across relational databases, Hadoop, and Iceberg.
- Architect graph database integrations for entity relationships, lineage, and semantic ontologies.
- Drive architecture roadmaps, design approvals, proof-of-concepts, compliance, and technology standards across multiple teams.
Requirements
- 5+ years of relevant industry experience and a bachelor's degree or comparable combination of education and experience.
- Experience with enterprise data architecture, data management, data warehousing, ETL/ELT, data modeling, APIs, and distributed computing.
- Strong architectural knowledge of on-premises Hadoop ecosystems, including HDFS, YARN, Hive, Spark, and Kerberos.
- Experience designing high-volume, low-latency data services and enterprise control, reconciliation, audit, governance, and lineage frameworks.
- Knowledge of SQL, machine learning, risk assessment, enterprise architecture, and logical data modeling.
- Must work in an in-office setting in Pittsburgh, Strongsville, or Dallas; does not provide employment visa sponsorship or participate in STEM OPT.
Nice to have
- Conceptual understanding of Agentic AI for pipeline observability, metadata tagging, self-healing quality checks, and schema drift mitigation.
- Experience with advanced analytics, visualization, and modernization of legacy Hadoop workloads.
Culture & Benefits
- Inclusive, supportive, and customer-focused in-office workplace.
- Medical, dental, vision, life, disability, HSA, and dependent-care benefits.
- 401(k) matching, pension, stock purchase plans, and educational assistance.
- Paid holidays, parental leave, occasional absence days, and 15–25 vacation days depending on career level.
- Wellness programs with financial incentives and additional family-care benefits.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
4 дня назад
Data Architecture Technical Principal (Insurance)
115 000 - 213 000$
5 дней назад
Data Architect (AI)
97 000 - 142 000$
VIA
5 дней назад
Senior Data Analytics Engineer (AI)
140 000 - 160 000$
3 дня назад
Senior Data Engineer (SQL/ETL)
121 900 - 140 000$
4 дня назад
Manager, Data Architecture and Strategy (Hybrid)
170 500 - 189 440$
5 дней назад
Data Product Architect (AI)
145 000 - 155 000$