Platform Engineer with AWS AgentCore Evaluation

Location: Armenia, Bulgaria, Cyprus, Georgia, Kazakhstan, Latvia, Poland, Romania, Serbia, or Ukraine

Company

hirify.global delivers software engineering and technology services for global projects.

What you will do

• Integrate the AWS AgentCore Evaluation API into CI/CD pipelines and automated deployment quality gates.
• Configure and maintain on-demand and online evaluation workflows, including sampling strategies.
• Develop GitHub Actions workflows for evaluation execution and deployment validation.
• Build CloudWatch dashboards and alarms for evaluation metrics, quality degradation, and operational issues.
• Collaborate with AI engineers, platform engineers, DevOps specialists, and cloud architects to define quality thresholds and standards.
• Support regression detection, release validation, observability, reporting, and technical documentation.

Requirements

• 3+ years of experience in platform engineering, DevOps engineering, or a related field.
• Experience integrating quality validation into CI/CD pipelines and designing deployment gates.
• Experience building and maintaining AWS CloudWatch dashboards, monitoring solutions, and operational alerting.
• Knowledge of cloud infrastructure, automation, deployment best practices, monitoring, and observability tools.
• Strong analytical and troubleshooting skills.
• Good written and verbal communication skills.

Nice to have

• Experience with AWS AgentCore Evaluation online mode configuration and sampling strategies.
• Experience comparing runtime versions and identifying regressions through evaluations.
• Knowledge of CloudWatch Embedded Metric Format (EMF).
• Experience with AI platform monitoring, evaluation frameworks, or automated quality assurance for machine learning and agent-based systems.
• Experience supporting enterprise-scale cloud platforms and deployment pipelines.

Culture & Benefits

• Vacation, sick pay, and state-holiday time off according to the laws and official calendar of the employment country.
• Health insurance support for employees and their loved ones.
• Coverage of IT certification costs and access to courses and learning platforms.
• Corporate events, colleague meetups, and workplace comfort support.
• Benefits may vary by region and contract type.