Creating a Dedicated AI Cluster in Generative AI for Hosting Models
Create a dedicated AI cluster resource in OCI Generative AI to host endpoints for pretrained base models and custom models.
Important
All OCI Generative AI foundational pretrained models supported for the on-demand serving mode that use the text generation and summarization APIs (including the playground) are now retired. If you host a summarization or a generation model such as
All OCI Generative AI foundational pretrained models supported for the on-demand serving mode that use the text generation and summarization APIs (including the playground) are now retired. If you host a summarization or a generation model such as
cohere.command
on a dedicated AI cluster, (dedicated serving mode), you can continue to use that model until it's retired. See Retiring the Models for retirement dates and definitions. We recommend that you use the chat models instead.