AI/ML Infra Meetup | Deployment, Discovery and Serving of LLMs at Uber Scale

March 6, 2025

Sean Po

Tse-Chi Wang

Watch this video to gain insights onhow Uber manages its Generative AI Gateway, which powers all generative AI applications across the company.

‍

AI/ML Infra Meetup | Deployment, Discovery and Serving of LLMs at Uber Scale from Alluxio, Inc.

Complete the form below to access the full overview:

Videos

AI/ML Infra Meetup | Building Production Platform for Large-Scale Recommendation Applications

March 6, 2025

AI/ML Infra Meetup | How Uber Optimizes LLM Training and Finetune

March 6, 2025

AI/ML Infra Meetup | Optimizing ML Data Access with Alluxio: Preprocessing, Pretraining, & Inference at Scale

March 6, 2025