Data Lakehouse and AI Data Platform Engineer (Vice President)

TL;DR

Data Lakehouse and AI Data Platform Engineer (Vice President): Design, build and support batch and streaming data pipelines on a modern Lakehouse and AI data platform with an accent on ingestion, transformation, modelling and optimization. Focus on developing reliable curated datasets for analytics, reporting and AI use cases, implementing data quality controls and partnering with stakeholders for production delivery.

Office location: New York, New York, United States

Salary range: USD 130,000 - 250,000

Company

Leading global investment firm building scalable data platforms to support AI, analytics and business decision-making.

What you will do

• Build, enhance and support batch and streaming data pipelines on Lakehouse and AI data platform.
• Refactor existing data flows for improved reliability, performance and maintainability.
• Develop raw, refined and curated datasets supporting analytics, reporting and AI use cases using sound data modelling principles.
• Implement data quality controls, reconciliation and monitoring standards.
• Collaborate with engineers, platform teams and data consumers to deliver outcomes on time.
• Contribute to technical design, standards and leadership for junior engineers.

Requirements

• 7-12+ years of experience in data engineering.
• Bachelor’s or master’s degree in relevant discipline or equivalent, with strong quantitative skills.
• Strong programming in Python or Java and good SQL knowledge including optimization.
• Experience with distributed processing like Apache Spark, data formats (JSON, Avro, Parquet).
• Understanding of temporal data modelling, schema design, partitioning and data quality practices.
• Familiarity with software engineering fundamentals: version control, testing, CI/CD.

Culture & Benefits

• Positioned at the center of the business, solving complex technical problems with scalable systems.
• Collaborative team environment focused on production delivery and reliability.
• Best-in-class benefits offered.
• Opportunities for long-term growth and expertise development within the firm.