Use model aliases in OCI Generative AI

OCI Generative AI now supports model aliases for applications and client code that use models in the on-demand serving mode. This feature simplifies model upgrades by automatically pointing to the latest version within a model family, eliminating manual updates.

Key Features

• Great for Testing: Use this feature for experimental and testing purposes.
• Seamless Upgrades: Automatically use the latest model version without manual intervention.
• Reduced Operational Overheads: No need to update the model IDs in the client code.
• Optional Use: Depending on the use case, add model aliases to some applications and keep model IDs for others.

Available Aliases

• cohere.command-latest → points to cohere.command-r-08-20204

• cohere.command-plus-latest → points to cohere.command-r-plus-08-2024

Access Methods

• Playground: Select the pretrained model with the -latest suffix (cohere.command-latest and cohere.command-plus-latest).
• API/CLI/SDK: Pass (cohere.command-latest and cohere.command-plus-latest) instead of their model ID. CLI Example:

  chat_detail.serving_mode = oci.generative_ai_inference.models.OnDemandServingMode(model_id = "cohere.command-latest")

Available Regions

Each alias is available in regions that host the on-demand mode of the model that it represents:

• Brazil East (Sao Paulo)
• Germany Central (Frankfurt)
• Japan Central (Osaka)
• UK South (London)
• US Midwest (Chicago)

Resources

• Pretrained Foundational Models in Generative AI
• Generative AI documentation