Senior Software Engineer – Open Source & SWE-Bench Evaluation

Added
1 hour ago
Type
Contract
Salary
Upgrade to Premium to se...

Related skills

machine learning data quality experiment design model evaluation statistical analysis
JobCopilot logo
Meet JobCopilot: Your Personal Al Job Hunter
Automatically Apply to Your Dream Jobs While You Sleep
Try it now →

📋 Description

  • Reviewing ML challenges and determining whether they are well designed and technically solvable
  • Evaluating whether datasets contain meaningful and learnable signals
  • Identifying unintended shortcuts or artifacts in synthetic datasets
  • Determining whether tasks require genuine diagnosis of the underlying ML problem
  • Reviewing evaluation metrics and improvement thresholds
  • Detecting metric gaming, data leakage, and evaluation flaws

🎯 Requirements

  • 3+ years of hands-on applied machine learning experience
  • Strong experience with: ML experiment design, Model selection, Hyperparameter tuning, Model
  • Strong understanding of train, validation, and test splits
  • Ability to identify: Data leakage, Label noise, Distribution shift, Spurious correlations, Feature
  • Experience evaluating whether performance improvements are statistically meaningful rather than
  • Strong understanding of ML evaluation metrics and when different metrics are appropriate
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Data Jobs. Just set your preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.

Related Data Jobs

See more Data jobs →