Senior Backend Engineer, Inference Platform at Together AISan Francisco · Responsibilities - Build and optimize global and local request routing, ensuring low-latency load balancing across data centers and model engine pods. - Develop auto-scaling systems to dynamically allocate resources and meet strict SLOs across dozens of data centers. - Design sys…Please enable JavaScript to use Risora.ai.

Senior Backend Engineer, Inference Platform at Together AI

San Francisco · Responsibilities - Build and optimize global and local request routing, ensuring low-latency load balancing across data centers and model engine pods. - Develop auto-scaling systems to dynamically allocate resources and meet strict SLOs across dozens of data centers. - Design sys…