Software Engineer (AI)

TL;DR

Software Engineer (AI): Building a global context layer for data and AI-driven tools to power search, discovery, and code generation with an accent on information retrieval and LLM integration. Focus on designing the brain of the context layer and turning R&D AI concepts into scalable production products.

Location: Hybrid, must be based in New York City (at least 3 days per week in office)

Salary: $200,000 - $230,000

Company

The company behind Astro, the industry-leading unified DataOps platform powered by Apache Airflow®.

What you will do

• Build intelligent systems that understand, reason about, and optimize the flow of data across organizations.
• Design and engineer components for data modeling, semantic search, retrieval, and code generation.
• Experiment with LLMs, embeddings, and cutting-edge retrieval techniques to create developer tools.
• Collaborate with R&D and product teams to bring early AI concepts to life in the product experience.
• Solve high-impact information retrieval and search challenges at a global scale.
• Influence the technical vision and architecture for next-generation AI-driven data products.

Requirements

• 5-8 years of software engineering experience with Python or Go.
• Must be based in New York City for a hybrid work model (3+ days/week in office).
• Experience with LLMs, vector databases, embeddings, or other applied AI areas.
• Comfort working with ambiguity in early-stage product development.
• Strong collaboration and communication skills for technical and non-technical audiences.

Nice to have

• Passion for AI systems for data, developer tools, or ML infrastructure.
• Familiarity with Apache Airflow or other orchestration tools.
• Demonstrated contributions to open source projects.
• Experience in search, IR, or large-scale data infrastructure.
• Experience building agentic systems on top of frontier models.

Culture & Benefits

• Flexible hybrid work model.
• Competitive compensation including an equity component.
• Comprehensive benefits package.
• Collaborative, research-driven environment that values velocity and creativity.
• Opportunity to represent the company through technical talks and open-source contributions.