Research Engineer, Large Language Models

Added
3 hours ago
Type
Full time
Salary
Salary not provided

Related skills

python pytorch machine learning jax deepspeed
JobCopilot logo
Meet JobCopilot: Your Personal Al Job Hunter
Automatically Apply to Your Dream Jobs While You Sleep
Try it now β†’

πŸ“‹ Description

  • Design and run large-scale pre-training and fine-tuning experiments, from small ablations to full
  • Study scaling laws to choose model size, data mix, and hyperparameters under a fixed compute budget.
  • Improve training efficiency through parallelism strategies (data, tensor, pipeline, FSDP), mixed
  • Diagnose and fix training instabilities such as loss spikes, divergence, and hardware failures.
  • Build and improve data pipelines, including filtering, deduplication, quality scoring, and dataset
  • Implement ideas from recent research papers and test whether they hold at scale.

🎯 Requirements

  • 3+ years of hands-on experience training deep learning models, or a PhD in a related field
  • Strong Python skills and deep expertise in PyTorch or JAX.
  • Practical experience with Transformer architectures, including attention, tokenization, embeddings
  • Experience with distributed training on multi-node GPU clusters (FSDP, DeepSpeed, Megatron-LM, or
  • Solid foundations in linear algebra, probability, statistics, and optimization.
  • Ability to read a research paper, implement it from scratch, and judge whether it works.
Get alerts for new remote engineering jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest β€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs β†’