Generative AI in Production
This 1-day course is an advanced look at taking generative AI applications into production.
Traditional MLOps covers productionizing classic ML systems, but generative AI raises new challenges in managing applications at scale. In the Generative AI in Production course you will learn about the challenges that come up when deploying and productionizing generative AI-powered applications, how to secure them, and best practices for logging and monitoring them in production.
Over five modules and four labs you will cover generative AI application deployment, productionizing generative AI (including a lab on tracking versions of generative AI applications), securing generative AI applications, and observability for production LLM systems.
The course is aimed at developers, DevOps engineers and machine learning engineers who want to operationalize GenAI-based applications. You should have completed Application Development with LLMs on Google Cloud or have equivalent knowledge.