Senior Staff Software Engineer, Serving

📋 Description

• Design, build, and operate high-throughput, low-latency services that process bid requests, execute
• Improve the performance, scalability, and reliability of systems handling millions of requests per
• Develop and optimize GPU-powered inference services using TensorRT to efficiently execute neural
• Profile complete inference pipelines and identify opportunities to optimize GPU utilization
• Partner with machine learning engineers to productionize new model architectures and features
• Design and operate large-scale feature store fleets providing low-latency access to real-time and

🎯 Requirements

• 10+ years of professional software engineering experience, with a strong track record working on
• Strong Computer Science fundamentals, including data structures, algorithms, distributed systems
• M.S. or higher in Computer Science or a related field, or equivalent professional experience.
• Strong ability to design and operate highly scalable, reliable, and performance-sensitive
• Experience working with machine learning infrastructure, model serving, inference systems, or other
• Strong analytical and performance-engineering skills, with the ability to identify bottlenecks and

🎁 Benefits

• Full-time remote work available across approved US states, including CA, CO, ID, IL, FL, GA, MA
• Competitive base salary based on location and experience.
• Base salary of $255,000–$310,000 for the San Francisco Bay Area, New York City, and Los
• Base salary of $234,000–$285,000 for Seattle/Olympia, Austin, San Diego, Santa Barbara, and Boston.
• Base salary of $219,000–$266,000 for other cities and towns within approved states.
• Equity as part of the overall compensation package.