Backend Engineer (AI Gateway)

Location: Plano, TX, USA

Compensation: USD 115,000–128,000 yearly

Company

hirify.global provides specialized services to clients and emphasizes service, responsibility, and servant leadership.

What you will do

• Build and operate an AI Gateway that routes, inspects, and governs traffic between enterprise clients and LLM/AI service providers.
• Develop production-grade REST and streaming APIs with async Python, FastAPI, Pydantic, dependency injection, and OpenAPI.
• Handle high-throughput streaming workloads, including chunked transfer, bidirectional streaming, back-pressure, WebSockets, SSE, and large payloads.
• Implement protocol and network capabilities across HTTP/2, HTTP/3, gRPC, TCP/UDP, TLS, reverse proxies, load balancers, and service meshes.
• Deploy and scale containerized services on Kubernetes using rolling updates, HPA/VPA, and canary or blue-green delivery.
• Build event-driven integrations, observability, security controls, and operational safeguards for reliable AI/LLM usage.

Requirements

• At least 3 years of hands-on experience with async Python, network programming, and FastAPI-based backend development.
• Experience with Docker, Kubernetes, cloud deployments on AKS, EKS, or GKE, and infrastructure as code with Terraform.
• Strong knowledge of streaming systems, HTTP/2 and HTTP/3, gRPC, Redis Streams, RabbitMQ or Kafka, and PostgreSQL performance tuning.
• Experience with cloud networking and security, including TLS termination, mTLS, reverse proxies, certificate automation, Vault, IAM, SSO, and audit logging.
• Experience building AI/LLM pipelines, PII anonymization, rate limiting, cost monitoring, and API gateway reliability patterns.
• 24/7 incident response experience and familiarity with SLA/SLO practices.

Nice to have

• Korean bilingual proficiency.
• Experience integrating CASB, DLP, WSS, Azure AD/Entra ID, Okta, SAML 2.0, or OIDC.
• Experience with Datadog, Prometheus/Grafana, or Azure Monitor.

Culture & Benefits

• Contract engagement with annual compensation of USD 115,000–128,000.
• Work focused on secure, high-performance AI infrastructure for enterprise clients.
• Confidential handling of candidate information under EEO guidelines.