Software Engineer, AI Platform and Services (AI)

TL;DR

Software Engineer, AI Platform and Services (AI): Designing and implementing GenAI agentic solutions to automate production environment management with an accent on retrieval-augmented generation (RAG) and secure action execution. Focus on building evaluation frameworks for LLMs, integrating agents with observability ecosystems, and optimizing model performance for real-world load.

Location: Richardson, TX, United States

Company

Marcus by hirify.global is a leading digital consumer bank providing high-yield savings and certificates of deposit with a focus on value and simplicity.

What you will do

• Design and implement tool-calling agents using MCP protocol for automated diagnostics and remediation.
• Build evaluation frameworks and retrieval pipelines for both open-source and foundational LLMs.
• Integrate AI agents with observability, incident management, and deployment systems for full traceability.
• Develop RAG pipelines, curate domain-knowledge, and establish data-quality validation frameworks.
• Implement safety guardrails, validator models, and policy checks to ensure governance and compliance.
• Optimize model cost and latency through prompt engineering, context management, and distillation.

Requirements

• Bachelor's degree in Computer Science, Applied Mathematics, Engineering, or a quantitative discipline (Masters/PhD preferred).
• 5+ years of experience as an applied data scientist or machine learning engineer.
• 5+ years of software development experience in Python, C/C++, Go, or Java, with a preference for large-scale Python applications.
• Proven track record of architecting and launching production ML systems, including serving, monitoring, and fine-tuning.
• Practical experience with LLM API integration, RAG, and tool-using agents (vector retrieval, function calling).
• Must be based in or able to work from the Richardson, TX office.

Nice to have

• Proficiency with AWS infrastructure including ECS/EKS, Lambda, S3, DynamoDB, and SageMaker.
• Experience with Infrastructure-as-Code (IaC) using Terraform or CloudFormation.

Culture & Benefits

• Access to "hirify.global University" for continuous learning in technical, business, and leadership skills.
• Meritocratic environment with structured tools and programs for career advancement.
• Commitment to diversity and inclusion through firmwide networks and equal opportunity practices.
• Comprehensive wellness, personal finance offerings, and mindfulness programs.