Senior Prompt Engineer (AI)

TL;DR

Senior Prompt Engineer (AI): Designing and refining technical migration workflows for transitioning templates to LLM autoraters with an accent on prompt engineering techniques and model performance optimization. Focus on manually drafting prompts to handle complex template architectures, troubleshooting anti-patterns, and measuring autorater quality against human baselines.

Location: Must be based in the United States

Компания

hirify.global is a global provider of AI-enabled localization and data services.

Что делать

• Utilize automated tools to create baseline prompts for parent-child template clusters.
• Supervise automated optimization tools and flag deadlocks or performance plateaus.
• Manually draft, test, and refine prompts to resolve complex architectural edge cases.
• Monitor shadowbot runs to track human-LLM rating disagreements.
• Measure autorater quality using accuracy metrics such as F1 scores, precision, and recall.
• Draft technical launch readiness documentation for final deployment.

Требования

• Native fluency in English required
• Must be based in the United States
• Bachelor’s, Master’s, or Doctorate in Computer Science, Data Science, Computational Linguistics, or related field
• At least 4 years of experience as a Prompt Engineer tuning LLMs
• Strong proficiency in identifying error patterns and analyzing model performance using SQL or data tools
• Proven ability to work with proprietary tools under minimal supervision

Хорошо, если есть

• Experience with enterprise LLM interfaces like Goose API
• Hands-on experience with Automated Prompt Optimization (APO) systems
• Expertise in computational linguistics, semantics, and logic

Культура и преимущества

• Comprehensive insurance package including medical, dental, and vision
• 401(k) retirement plan with eligibility
• Paid sick time and Employee Assistance Program
• Voluntary life, accident, and critical illness insurance coverage