Data, Lakehouse and AI Data Platform Engineer (AI)

TL;DR

AI Data Platform Engineer (AI): Designing and building modern Lakehouse and AI data platforms to support firm-wide analytics and AI capabilities with an accent on scalable data pipelines and curated datasets. Focus on implementing distributed data processing using Spark, ensuring data quality through reconciliation, and developing robust data models.

Location: Must be based in Dallas, Texas, United States

Company

A leading global investment banking and financial services corporation.

What you will do

• Build and support batch and streaming data pipelines on the Lakehouse and AI data platform.
• Develop raw, refined, and curated datasets to support analytics and AI use cases.
• Implement data quality controls and reconciliation approaches to ensure production accuracy.
• Refactor and modernize existing data flows to improve reliability, performance, and maintainability.
• Collaborate with platform teams and consumers to deliver reliable, scalable data products.
• Contribute to shared tooling and framework components to improve platform operations.

Requirements

• 7-12+ years of experience in data engineering.
• Strong programming experience in Python or Java.
• Proficiency in SQL, including troubleshooting and optimization.
• Experience with distributed data processing frameworks, specifically Apache Spark.
• Knowledge of software engineering fundamentals, including CI/CD and version control.
• Understanding of temporal data modelling and schema design.

Nice to have

• Experience with Snowflake, Apache Iceberg, or Databricks.
• Knowledge of Kafka and Hadoop ecosystem technologies.
• Familiarity with Kubernetes-based deployment approaches.
• Experience with Avro and Parquet data formats.

Culture & Benefits

• Opportunity to work at the center of the business, turning data into actionable business outcomes.
• Collaborative engineering environment focused on solving complex technical problems at scale.
• Exposure to a modern and evolving technology stack.
• Career growth opportunities and technical leadership paths within the firm.