How to Operationalize Transformer Models on the Edge

Sometimes the hardest part of building ML solutions is deployment. In this session, we will look at different model deployment architectures, how to deploy with edge devices and inference in different programming languages. By the end of the demo-heavy session, you will see how to optimize large models, reduce costs, and deploy anywhere.