Senior Data Engineer (AI)

TL;DR

Senior Data Engineer (AI): Architecting and operating next-generation data platforms that empower research, systematic trading, AI, and risk analytics with an accent on 24x7 reliability, IaC-driven deployments, and high-throughput pipelines. Focus on building high-performance Lakehouse tables, exposing curated datasets via robust APIs, and optimizing workflows for aggressive SLAs.

Location: New York, New York, United States (Onsite)

Salary: $150,000–$190,000

Company

hirify.global is a global multi-manager hedge fund that strives to deliver industry-leading risk-adjusted returns for investors.

What you will do

• Architect and operate the data platform with 24x7 reliability, IaC-driven deployments, and tight cost controls.
• Build and evolve batch and streaming pipelines ingesting billions of market-data events daily.
• Architect high-performance, cost-efficient Lakehouse tables.
• Expose curated datasets via robust, versioned APIs for quants and AI agents.
• Optimize workflows to meet aggressive SLAs, embedding observability and automated data quality checks end-to-end.
• Champion Infrastructure-as-Code with Git-driven CI/CD for every data asset.
• Mentor junior engineers and enforce best-in-class coding standards.

Requirements

• 7+ years building production data platforms with Python and SQL.
• Deep expertise in big-data architecture: partitioning, sharding, columnar formats.
• Hands-on experience with SingleStore/MemSQL, Spark/Flink/EMR, and event buses (Kafka/Kinesis).
• Proven AWS skills plus Terraform / CloudFormation infrastructure-as-code mastery.
• Experience delivering data services for AI/ML workloads and feature pipelines.
• Performance-tuning Postgres, SingleStore/MemSQL, or KDB for sub-second queries.
• Proficient in API design, versioning, and OpenAPI/Swagger documentation.

Nice to have

• Market-data domain expertise (tick, options, macro).
• Mastery of Iceberg, Delta Lake, or Hudi on S3.
• Experience building AI/ML feature stores or RAG pipelines.

Culture & Benefits

• Inclusive culture that values diverse backgrounds and voices.
• Investment in talent, fostering continuous learning, innovation, and the pursuit of ambitious goals.
• Teamwork-oriented, collaborative environment that encourages ideas at all levels.
• Learning and educational offerings and opportunities to make an impact.
• Community building through internal networks, external partnerships, and service initiatives.
• Competitive benefits package.