Назад
Company hidden
3 дня назад

Lead AI Gateway Engineer

93 000 - 89 000$
Формат работы
onsite
Тип работы
fulltime
Грейд
lead
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Lead AI Gateway Engineer (AI Gateway/API Infrastructure): Building and operating Huntington’s enterprise gateway for secure, governed access to approved AI models with an accent on model routing, provider abstraction, security policy enforcement, resiliency, observability, and consumption controls. Focus on designing high-availability gateway infrastructure, automating Terraform and CI/CD deployments, integrating cloud and enterprise AI services, and leading complex incident remediation.

Location: Office-based in Columbus, OH, Downers Grove, IL, or Minnetonka, MN, United States

Base salary: USD 89,000–93,000 annually, plus incentive compensation eligibility

Company

hirify.global provides banking and financial services.

What you will do

  • Design, build, and operate enterprise AI Gateway and API Gateway services and supporting infrastructure.
  • Integrate approved models and providers including Google Vertex AI, Gemini, Anthropic, and internally hosted models.
  • Implement provider abstraction, model routing, authentication, authorization, OAuth, traffic management, threat protection, quotas, rate limits, and data-protection policies.
  • Engineer high availability, failover, retries, timeouts, health checks, disaster recovery, and production resiliency.
  • Automate gateway infrastructure, configuration, onboarding, testing, and deployment through Terraform and CI/CD pipelines.
  • Monitor AI and API traffic, model usage, token consumption, latency, errors, availability, and policy decisions; lead troubleshooting and root-cause remediation.

Requirements

  • At least 7 years of software, platform, cloud, integration, or API engineering experience.
  • Working knowledge of generative AI model APIs, streaming responses, tokens, context limits, and provider quotas.
  • Strong experience designing and operating API gateways, API management platforms, and AI Gateways.
  • Hands-on experience with API proxies, routing, transformations, authentication, authorization, quotas, rate limiting, and threat protection.
  • Experience with REST APIs, HTTP, JSON, streaming interfaces, OAuth 2.0, OpenID Connect, JWT, TLS, certificates, and workload identity.
  • Software-development experience with Python, Go, Java, JavaScript, or TypeScript.
  • Experience with Google Cloud or another major cloud provider, containers, and Kubernetes.
  • Strong hands-on Terraform experience, including reusable modules, remote state, automated validation, gateway resources, networking, identities, and environment-specific configurations.
  • Experience with Git-based development, CI/CD pipelines, automated testing, monitoring, logging, distributed tracing, high availability, disaster recovery, performance engineering, and production incident management; ability to lead complex designs and influence multiple engineering teams.

Nice to have

  • Experience with Apigee, LiteLLM, Google Cloud AI services, Kong AI Gateway, Azure API Management AI Gateway, or similar technologies.
  • Experience managing Apigee configuration and working with Vertex AI, Gemini, Anthropic, Amazon Bedrock, Azure OpenAI, or self-hosted models.
  • Knowledge of model routing, semantic caching, token accounting, cost controls, model fallback patterns, Model Armor, content-safety controls, data-loss prevention, and prompt or response inspection.
  • Familiarity with MCP and A2A protocols and the boundaries between API Gateway, AI Gateway, and Agent Gateway responsibilities.
  • Experience supporting shared technology platforms in a regulated environment.

Culture & Benefits

  • Office workplace model; certain positions may be eligible for flexible work arrangements subject to hiring-team confirmation.
  • Health insurance, wellness programs, life and disability insurance, retirement savings, paid leave, paid holidays, and paid time off.
  • Equal opportunity employer with a tobacco-free hiring practice.
  • Exempt position and therefore not eligible for overtime pay.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →