Senior Software Engineer (AI)

🚀 WE’RE HIRING: Senior Software Engineer – LLM Evaluation & Repository Validation
Turn real-world code challenges into better AI capabilities.
Help build verifiable software engineering tasks from public repository histories to train and evaluate large language models.
📍 Role details
• 🌍 Global | Fully remote
• Commitment: 20 hours/week with some PST overlap.
• Contract: 3-month contractor assignment; expected start next week.
• Benefits: No medical coverage or paid leave.
• Compensation and payment terms: Not specified.
🌟 The opportunity
• Combine practical software engineering with AI research.
• Influence how LLMs handle realistic development challenges across languages and difficulty levels.
• Opportunities to lead junior engineers on collaborative projects.
🛠️ What you’ll do
• Analyze and triage GitHub issues across trending open-source libraries.
• Configure repositories, automate development environments, and Dockerize projects.
• Evaluate unit test coverage and quality.
• Modify and run codebases locally to assess AI bug-fixing performance.
• Partner with researchers to identify repositories and issues that challenge LLMs.
🎯 What you’ll bring
• Tech lead-level engineering experience with well-maintained, widely used public repositories featuring 500+ stars.
• Strong skills in at least one: Python, JavaScript, Java, Go, Rust, C/C++, C#, or Ruby.
• Proficiency with Git, Docker, and basic software pipelines.
• Confidence navigating, modifying, and testing complex codebases.
• Open-source contributions, LLM evaluation, or developer-tool experience are a plus.
Bring your engineering judgment to the future of AI-assisted development.
Application link: [Показать контакты]
#Hiring #SoftwareEngineering #LLMEvaluation #OpenSource #RemoteJobs