Journey to 1000 models: Scaling Instagram’s recommendation system

At the beginning of 2023, Instagram had O(10) gpu models, a manual release process, and a manual monitoring setup. Today, we've successfully scaled our algorithm to manage over 1000 machine learning