Database Systems Evaluation Expert

📋 Description

• Design one challenging, self-contained database engineering task that evaluates an AI agent's
• Develop clear problem statements and provide reproducible repositories or technical environments
• Implement a working reference solution that demonstrates the expected engineering approach and
• Create comprehensive tests to verify correctness, error handling, concurrency behavior, retry
• Evaluate system performance using relevant metrics, including latency, throughput, memory
• Develop detailed grading rubrics that distinguish robust engineering solutions from implementations

🎯 Requirements

• At least five years of hands-on experience working with database engine internals, or a PhD in
• Deep technical knowledge of one or more database systems areas, such as storage engines, query
• Strong software implementation skills and the ability to develop reliable, testable solutions to
• Demonstrated understanding of correctness, performance optimization, concurrency, failure handling
• Ability to construct meaningful technical tests, establish measurable performance criteria, and
• Strong analytical and problem-solving skills, with the ability to break down complex technical

🎁 Benefits

• Competitive project compensation: Earn $2,200 for completing the assigned evaluation task, subject
• Defined project scope: Complete one specialized database engineering task requiring approximately
• Remote work arrangement: Contribute from your preferred location in India without the need for a
• Flexible assessment schedule: Complete the self-paced technical assessment at your own pace, with
• Technical feedback: Receive feedback following the technical review of your completed task
• Advanced AI exposure: Apply your database engineering expertise to evaluate the capabilities of AI