Senior Engineer, Competitive Benchmarking & Performance

📋 Description

• Own prioritized competitive benchmarking initiatives across search, vector and hybrid retrieval
• Build and maintain automated benchmark harnesses, datasets, query sets, and load profiles that
• Design fair comparisons with documented system versions, configurations, tuning decisions, resource
• Evaluate latency distributions, throughput, resource consumption, and cost efficiency. For
• Adapt and extend workload-appropriate tools such as Elasticsearch Rally, ClickBench, and vector
• Investigate performance differences using profiling, system metrics, and controlled experiments

🎯 Requirements

• Solid software engineering skills, with experience building maintainable automation and analysis
• Hands-on experience evaluating and diagnosing performance in distributed systems, databases, or
• Depth in at least one relevant area (search, vector retrieval, analytical databases, or
• Experience designing representative datasets and workloads, including query patterns, concurrency
• Sound experimental judgment, including repeated measurements, variability analysis, warm-up and
• Experience building reproducible test environments and documenting configurations, procedures, and

🎁 Benefits

• Competitive pay based on the work you do here and not your previous salary
• Health coverage for you and your family in many locations
• Ability to craft your calendar with flexible locations and schedules for many roles
• Generous number of vacation days each year
• Increase your impact - We match up to $2000 (or local currency equivalent) for financial donations
• Up to 40 hours each year to use toward volunteer projects you love