3 дня назад
Software Engineer - AI Performance
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Software Engineer - AI Performance (AI benchmarking and cloud infrastructure): Building benchmarking infrastructure, agent evaluation pipelines, and telemetry systems for measuring enterprise AI performance with an accent on profiling, observability, and model-serving systems. Focus on designing metrics for reasoning, accuracy, latency, alignment, and real-world customer outcomes.
Location: Remote in the Philippines
Company
builds Computer, an AI teammate and AI-native SaaS platform that unifies data sources, tools, and workflows for enterprise teams.
What you will do
- Complete structured training in AI benchmarking, profiling, telemetry, and performance tuning.
- Build and scale benchmarking infrastructure for evaluating enterprise AI systems.
- Design agent evaluation pipelines measuring reasoning, accuracy, alignment, user outcomes, latency, and quality.
- Instrument model-serving systems based on vLLM, Triton, Ray, or Kubernetes.
- Develop data and telemetry pipelines for model performance measurement.
- Collaborate with AI, infrastructure, and cross-functional teams to create benchmarks that reflect customer value and system impact.
Requirements
- 3–10+ years of experience as a Software Engineer in backend, systems, or infrastructure roles.
- Strong foundation in Python or a similar backend language such as Go, Java, C#, or Node.
- Hands-on experience building APIs and cloud-native architectures using AWS, GCP, or Azure.
- Understanding of metrics, profiling, or observability tools such as Grafana, Prometheus, or ELK.
- Curiosity and commitment to learning AI benchmarking, LLM evaluation, and performance frameworks.
- Strong analytical and product intuition, with attention to what benchmarks represent and measure.
Nice to have
- Experience with Kubernetes.
- Exposure to vector search or model tuning with LoRA or DPO.
- Open-source contributions.
Culture & Benefits
- Structured training and mentorship for transitioning into AI performance engineering.
- Opportunity to contribute to open benchmarking frameworks for intelligent SaaS software.
- Cross-functional collaboration with AI and infrastructure teams.
- Equal opportunity employment.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →