10 дней назад
Agentic AI Systems Evaluation Engineer (AI)
130 700 - 205 200$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Agentic AI Systems Evaluation Engineer (AI) (AI systems evaluation and software engineering): Defining measurement methodologies and benchmarking frameworks to quantify customer outcomes, platform performance, and AI workload effectiveness with an accent on telemetry analytics, performance benchmarking, and software engineering strategy. Focus on analyzing complex system results, producing executive performance reports, validating Linux and Windows environments, and building scalable automation for modern software platforms.
Location: Spring, Texas, United States of America; 4-days-per-week in-office requirement in Houston
Salary: $130,700–$205,200 USD annually, plus potential bonus and/or equity for US candidates
Company
develops software, hardware, and technology services for customers and organizations.
What you will do
- Define success metrics and create benchmarking frameworks for customer outcomes, platform performance, and AI workloads.
- Analyze customer outcomes and produce executive performance reports.
- Contribute to software engineering strategy, roadmaps, and proof-of-concept initiatives.
- Build and maintain technical solutions that help engineering teams deliver software faster.
- Manage stakeholder relationships, supervise external engineering vendors, and provide technical guidance and coaching.
- Recommend and implement improvements to engineering, implementation, and service strategies.
Requirements
- Four-year or graduate degree in Computer Science, Statistics, Software Engineering, or a related discipline, or equivalent demonstrated competence.
- Typically 7–10 years of experience in software design and development, software architecture, programming, or a related field.
- Strong analytical skills and experience with benchmarking methodologies.
- Experience with Agile methodology, automation, DevOps, APIs, microservices, scalability, and software engineering.
- Programming experience with languages such as C++, Java, JavaScript, or Python, plus SQL.
- Ability to work in the Houston office four days per week.
Nice to have
- AI systems evaluation, telemetry analytics, and performance benchmarking experience.
- Linux and Windows validation experience.
- Experience with AWS, Microsoft Azure, Docker, Kubernetes, React, and full-stack development.
- Programming language certification.
Culture & Benefits
- Health, dental, and vision insurance.
- Short- and long-term disability, life insurance, employee assistance, and flexible spending benefits.
- Paid parental leave of 4–12 weeks depending on tenure.
- Eleven paid holidays plus flexible vacation and sick leave.
- Travel expectation of approximately 25%.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
11 дней назад
System Software Engineer (AI)
120 500 - 243 000$
2 дня назад
AI Software Engineer
120 000 - 150 000$
11 дней назад
Principal/Senior Software Engineer, Agentic UX (AI)
246 000 - 370 000$
WRITER
11 дней назад
Software Engineer Agents (AI)
132 000 - 240 000$
Anthropic
13 дней назад
Applied AI Engineer (Enterprise Tech)
200 000 - 320 000$
13 дней назад
Principal AI Engineer
175 000 - 200 000$