Senior Software Engineer – LLM Evaluation

📋 Description

• Curate high-quality software examples and datasets for model training, coding benchmarks, and
• Develop precise solutions to software-engineering tasks and correct or improve implementations
• Evaluate AI-generated code for technical correctness, maintainability, efficiency, scalability
• Identify implementation weaknesses, recurring model-generated errors, and patterns that reveal gaps
• Provide clear, structured rationales supporting technical evaluation decisions.
• Build agents and automated mechanisms capable of assessing code quality and verifying software

🎯 Requirements

• 3+ years of professional software-engineering experience.
• Strong full-stack development capabilities and experience building scalable, production-grade
• Strong understanding of software architecture, system design, API design, and production
• Deep knowledge of software development, debugging, code review, and code-quality assessment.
• Demonstrated experience reviewing, troubleshooting, and improving complex software implementations.
• Proficiency in one or more relevant programming languages, including Python, JavaScript, Java, C++

🎁 Benefits

• Fully remote, part-time independent contractor engagement.
• Flexible workload starting at 10 hours per week, with the potential to work up to 40 hours per week.
• Approximately one-month initial project duration, with potential extension based on performance and
• Opportunity to contribute directly to advanced LLM evaluation, coding benchmarks, and AI-assisted
• Exposure to cutting-edge AI evaluation workflows and research involving real-world
• Opportunity to apply professional engineering expertise to improve how AI systems are evaluated