Use Cohere Command R and R+ 08-2024 in OCI Generative AI
- Services: Generative AI
- Release Date: November 14, 2024
OCI Generative AI now supports the latest updates to Cohere's Command R and Command R+ models (08-2024). These large language models bring enhanced capabilities and efficiency to OCI's enterprise AI offerings.
- Key Highlights
-
- Both models feature significant performance improvements in latency and throughput.
- Both models are offered with a 128,000 token context length on existing unit shapes.
- Command R 08-2024 rivals the previous R+ version in math, coding, and reasoning.
- Both models are available for on-demand inferencing and single-tenant hosting.
- Command R 08-2024 fine-tuning is supported with LoRA (Low Rank Adaptation) and T-Few training methods.
- Available Regions
-
US Midwest (Chicago), Germany Central (Frankfurt), UK South (London), and Brazil East (Sao Paulo).
- New Features and Improvements
-
- Enhanced multilingual retrieval-augmented generation (RAG) feature with customizable citation options
- Significant advancements in coding, math, and reasoning capabilities
- Improved structured data analysis for finance, Software as a Service (SaaS), and consulting use cases
- New Structured Outputs feature for user-defined JSON generation
The 08-2024 versions offer better performance with Command R 08-2024 showing remarkable gains across all benchmarks.
You can now leverage these latest models without infrastructure management concerns. Access is available through chat interfaces, API, and dedicated endpoints, with fine-tuning support for Command R 08-2024.
The Cohere Command R (cohere.command-r-16k
) and Cohere Command R+ (cohere.command-r-plus
) models are now deprecated in OCI Generative AI. For retirement dates, see Retiring the Models.
For a list of offered models, see Pretrained Foundational Models in Generative AI. For information about the service, see the Generative AI documentation.