Senior Data Engineer (AI)

TL;DR

Senior Data Engineer (AI): Architecting and operating next-generation data platforms for research, systematic trading, AI, and risk analytics with an accent on 24x7 reliability, IaC-driven deployments, and cost controls. Focus on building and evolving high-throughput pipelines, architecting high-performance Lakehouse tables, and exposing curated datasets via robust APIs.

Location: Onsite in New York, New York, United States

Salary: $150,000–$190,000

Company

hirify.global is a global multi-manager hedge fund delivering risk-adjusted returns by leveraging internal and external portfolio manager teams and proprietary technology.

What you will do

• Architect and operate the data platform ensuring 24x7 reliability, IaC-driven deployments, and tight cost controls.
• Build and evolve batch and streaming pipelines ingesting billions of market-data events daily.
• Architect high-performance, cost-efficient Lakehouse tables.
• Expose curated datasets via robust, versioned APIs for quants and AI agents.
• Optimize workflows to meet aggressive SLAs, embedding observability and automated data quality checks.
• Champion Infrastructure-as-Code with Git-driven CI/CD for data assets.
• Mentor junior engineers and enforce best-in-class coding standards.

Requirements

• 7+ years building production data platforms with Python and SQL.
• Deep expertise in big-data architecture: partitioning, sharding, columnar formats.
• Hands-on experience with SingleStore/MemSQL, Spark/Flink/EMR, and event buses (Kafka/Kinesis).
• Proven AWS skills plus Terraform / CloudFormation infrastructure-as-code mastery.
• Experience delivering data services for AI/ML workloads and feature pipelines.
• Experience building AI/ML feature stores or RAG pipelines.
• Performance-tuning Postgres, SingleStore/MemSQL, or KDB for sub-second queries.
• Proficient in API design, versioning, and OpenAPI/Swagger documentation.

Nice to have

• Market-data domain expertise (tick, options, macro).
• Mastery of Iceberg, Delta Lake, or Hudi on S3.
• Hands-on work with real-time analytics engines such as SingleStore/MemSQL.

Culture & Benefits

• Invest in attracting and retaining top talent, fostering continuous learning and innovation.
• Teamwork-oriented, collaborative culture encouraging ideas at all levels.
• Provide learning and educational offerings and opportunities for impact.
• Encourage community through internal networks, external partnerships, and service initiatives.
• Competitive benefits package.