AI Platform Engineer (Fintech)

TL;DR

AI Platform Engineer (Cloud/AI Infrastructure): Designing and operating the AI platform, including cloud infrastructure, AI serving layers, and developer tooling with an accent on LLM gateway and model serving infrastructure. Focus on ensuring platform reliability through observability, implementing governance controls, and optimizing GPU costs for inference workloads.

Location: Hybrid (3 days/week in office) in Boston, Springfield, or New York

Salary: $134,400–$176,400

Company

hirify.global is a large-scale financial services and insurance corporation providing stable ethical business operations and industry-leading benefits.

What you will do

• Design and implement cloud infrastructure, AI serving layers, and developer tooling to support enterprise AI initiatives.
• Own and develop critical platform components, including the LLM gateway and model serving infrastructure.
• Produce technical documentation and Architecture Decision Records (ADRs) to maintain engineering standards.
• Implement observability instrumentation and support platform stability through SLO definitions and incident response.
• Develop governance and compliance controls for data residency, access management, and audit logging.
• Collaborate with cross-functional AI engineering and product teams to communicate technical trade-offs.

Requirements

• Must be based in or able to work from Boston, Springfield, or New York (Hybrid: 3 days/week in office).
• 2+ years of experience in platform, infrastructure, or SRE roles.
• 2+ years of experience with cloud-native architecture across AWS, GCP, or Azure.
• 2+ years of experience with IaC and GitOps tools such as Terraform or Pulumi and ArgoCD.
• Proven ability to deliver platform features from development through production.

Nice to have

• Proficiency with Kubernetes (CKA, CKAD certifications).
• Experience with LLM serving frameworks like vLLM, Triton, or Ray Serve.
• Knowledge of FinOps principles and GPU cost considerations for inference.
• Contributions to internal developer platforms (IDPs) or open-source ML infrastructure.

Culture & Benefits

• Industry-leading pay and comprehensive corporate benefits.
• Culture of peer learning, candid feedback, and high shared technical standards.
• Access to diverse Business Resource Groups (LGBTQIA+, women, veteran, etc.).
• Professional growth opportunities via Degreed and other learning platforms.
• Stable work environment with a strong emphasis on ethics and integrity.