Senior Machine Learning Engineer

📋 Description

• Develop, optimize, and productionize ML models for Cloudflare's serverless inference.
• Build benchmarking and evaluation frameworks for latency, throughput, and model behavior.
• Improve inference performance via quantization, batching, caching, and runtime tuning.
• Partner with systems engineers to integrate models into distributed inference across GPUs.
• Improve deployment workflows: validation, rollout safety, observability, and testing.
• Mentor engineers and raise ML production quality across the team.

🎯 Requirements

• Experience building, optimizing, and operating machine learning models in production environments.
• Strong Python skills and ML frameworks such as PyTorch, TensorFlow, or JAX.
• Hands-on inference optimization for large-scale models (quantization, batching, caching, tuning).
• Experience with large-scale inference runtimes (e.g., vLLM, TensorRT-LLM, ONNX Runtime, Triton).
• Familiarity with LLMs, speech, vision, embeddings, and multimodal models.
• Experience optimizing models for GPUs or specialized accelerators.

🎁 Benefits

• Equal opportunity employer with commitment to diversity and inclusion.