Staff Engineer, Inference Optimizations

📋 Description

• Lead benchmarking and performance optimization for inference engine and GPU kernels.
• Serve as IC leader to solve memory bandwidth and compute bottlenecks.
• Guide the technical roadmap for high-performance inference workloads.
• Architect decisions to maximize throughput and minimize latency for large models.
• Mentor engineers via code and design reviews to raise the technical bar.
• Collaborate with Product Management and TPMs to translate hardware limits into shippable features.

🎯 Requirements

• 5+ years in HPC or AI infrastructure.
• Gen AI literacy: LLM, VLM, LMM.
• Optimization expert: attention layers and distributed GPU parallelism.
• Hardware fluency: NVIDIA/AMD GPUs; CUDA, ROCm.
• Open source mastery: experience building with and contributing to OSS.
• Systems design: low-level GPU programming, memory access, parallel execution.

🎁 Benefits

• Innovative, purpose-driven culture for builders.
• Career development resources and training.
• Comprehensive benefits and well-being programs.
• Competitive salary, equity, and bonus structure.
• Remote-friendly and flexible work options.
• Inclusive, equal-opportunity employer.