AI Runtime and ML Model Systems Engineer

📋 Description

• Define runtime architectures and performance strategies for AI workloads across heterogeneous
• Assess how model types, hardware capabilities, memory requirements, and workload behavior should
• Design runtime abstraction layers and interfaces that connect applications and models to inference
• Define model placement, scheduling, and routing policies across CPU, GPU, and NPU resources
• Evaluate inference technologies such as ONNX Runtime, TensorRT, and OpenVINO to guide framework
• Establish approaches for memory allocation, model lifecycle management, and resource coordination

🎯 Requirements

• 7+ years of experience in systems engineering, software architecture, AI runtimes, or a related
• Experience designing AI runtime systems, inference platforms, or model execution frameworks for
• Strong understanding of how AI models use compute engines, memory, and hardware acceleration
• Experience with inference frameworks such as ONNX Runtime, TensorRT, or OpenVINO and an
• Ability to translate product and performance requirements into system architectures, interface
• Strong software engineering fundamentals, including APIs, concurrency, memory management, and the

🎁 Benefits

• Health insurance
• Dental insurance
• Vision insurance
• Long term/short term disability insurance
• Employee assistance program
• Flexible spending account