Operating Systems Engineer, On-Device Inference | Consumer Devices

📋 Description

• Build the inference platform: Design and implement maintainable OS services, frameworks, and clear
• Fit models to device constraints: Partner with researchers on quantization, runtime integration
• Coordinate system resources: Develop scheduling and resource policies that balance inference with
• Advance performance and power management: Develop and validate execution strategies that adapt to
• Debug across the stack: Use tracing, profiling, and structured debugging to investigate
• Measure and validate improvements: Build diagnostic tools, instrumentation, representative device

🎯 Requirements

• Substantial hands-on experience designing, developing, and debugging operating system components
• Proficiency in C++ for systems development, including concurrent programming, memory ownership, and
• Hands-on experience integrating or optimizing inference runtimes or machine learning workloads in
• Strong understanding of scheduling, memory management, and how workloads compete for shared system
• Experience diagnosing complex system behavior and delivering performance or power improvements
• Ability to work across disciplines, translate research and product needs into system requirements

🎁 Benefits

• Have delivered end-to-end on-device inference in shipped products, from model adaptation and
• Have adapted models for deployment through quantization, compression, or related techniques
• Have optimized inference across CPUs, GPUs, or neural accelerators, accounting for data movement
• Are proficient in Rust for systems programming.
• Take ownership of complete solutions and follow problems across model, runtime, and operating
• Challenge assumptions, develop new approaches when existing techniques fall short, and use