Senior Software Engineer, AI Memory and Workload

Added
14 minutes ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

python pytorch ai memory management onnx runtime

πŸ“‹ Description

  • Leads the technical evaluation and incubation of emerging AI technologies and software components
  • Develops prototypes and implements software/runtime optimizations to improve AI workload execution
  • Analyzes how AI workloads map across CPU, GPU, NPU (heterogeneous execution), system RAM
  • Investigates hardware inferencing mechanics and system runtimes (such as llama.cpp) to identify AI
  • Evaluates the impact of concurrent AI and non-AI workloads on foreground application
  • Investigates workload prioritization and Quality of Service across CPU, GPU, and NPU resources

🎯 Requirements

  • Four-year or Graduate Degree in Computer Science, Computer Engineering, Software Engineering, or
  • Typically 7-10 years of work experience, preferably in systems software engineering, performance
  • AI Runtime Mechanics & Execution: hands-on experience with inference runtimes and execution
  • Memory Management & Architecture: expertise in memory mapping, VRAM/RAM allocation, KV cache
  • Data Analytical skills: ability to report test results and communicate technical risks, tradeoffs
  • Systems Performance & Bottleneck Analysis: identifying hardware/software bottlenecks

🎁 Benefits

  • Health insurance
  • Dental insurance
  • Vision insurance
  • Long term/short term disability insurance
  • Employee assistance program
  • Flexible spending account
Get alerts for new remote engineering jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest β€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs β†’