Senior Software Engineer (Python, Gen AI)

TL;DR

Senior Software Engineer (Python, Gen AI): Building and delivering production-grade generative AI services with an accent on Python development, prompt engineering, observability, and secure deployment. Focus on designing LLM evaluation workflows, standardizing service tracing and logs, and owning deployments through OpenShift, Helm, and GitOps.

Location: Charlotte, North Carolina; day-one onsite presence required with a hybrid work arrangement. Columbia is also listed in the role conditions.

Salary: $103,330–$128,656 gross annual base salary for a full-time position, plus potential variable compensation and benefits.

Company

hirify.global delivers data infrastructure and systems solutions that help organizations improve data processes and business outcomes.

What you will do

• Develop and deliver production services in Python 3.11 using generative AI and LLM technologies.
• Design and maintain production prompts and coding-agent prompts for tools such as Devin, Claude, Copilot, and Codex.
• Build LLM evaluation workflows, including LLM-as-a-judge approaches.
• Implement consistent OpenTelemetry tracing and structured logging across services.
• Own service deployments using OpenShift, Helm, and GitOps.
• Apply secure engineering practices, including secret handling, mTLS, audit trails, and preventing PII exposure in logs.

Requirements

• Senior-level hands-on software engineering and delivery experience with Python.
• Production experience with Python 3.11 and generative AI application development.
• Experience with prompt engineering for both product prompts and coding agents.
• Knowledge of OpenTelemetry tracing and structured logging standards.
• Experience with OpenShift, Helm, and GitOps-based deployments.
• Security-conscious development experience, including secret management, mTLS, audit trails, and PII protection.

Nice to have

• Experience designing PII masking solutions and using Splunk Observability Cloud, SPLOC, or Arize.
• Familiarity with model provider abstraction and vLLM.
• OpenTelemetry and security-aware coding experience.
• Experience working in a Python and Gen AI group.

Culture & Benefits

• Hybrid work with flexible work options.
• Medical, dental, vision, mental health, and well-being programs.
• 401(k), employee share ownership, paid time off, and paid holidays.
• Paid parental leave and family-building benefits.
• Mentoring, coaching, learning programs, employee resource groups, and backup care support.