LoRAX (LoRA eXchange) is a framework that allows users to serve thousands of fine-tuned models on a single GPU, dramatically reducing the cost of serving without compromising on throughput or latency.

Meta ( META) had been using Google's Gemini models for tasks such as content moderation and scam detection because they ...