Hardware Unit Shapes by Region

The following table lists hardware shapes for the North America regions.

The following table lists hardware shapes for the South America regions.

The following table lists hardware shapes for the Europe regions.

The following table lists hardware shapes for the Middle East regions.

The following table lists hardware shapes for the Asia Pacific regions.

The following table lists the service limit, required hardware units, and AI unit count for each hardware unit shape. The AI unit count is determined by the hardware shape and the number after X. A provider or model-family prefix doesn't change the AI unit count. For example, look up H100_X2 in this table for either H100_X2 or Cohere_H100_X2.

The AI Unit Count is the pricing multiplier for one replica of a hardware unit shape. To estimate the hourly price for one replica, multiply the applicable AI Unit Per Hour price on the Pricing Page by the AI unit count in the table. If the cluster has more than one replica, also multiply the result by the number of replicas.

Use the Oracle Cloud Cost Estimator to estimate the cost of your dedicated AI cluster configuration. If the tenancy doesn't have enough limits for the selected hardware shape and unit count, Creating a Limit Increase Request.

For an imported model, select a compatible hardware unit shape that's available in the target region. Imported-model unit shape names don't include a provider prefix because you select the imported model separately when you create the hosting dedicated AI cluster. For example, H100_X2 requires two H100 hardware units. See Hardware Unit Shapes, Service Limits, and AI Unit Counts for its service limit and AI unit count.

Use the region summary tables on this page to identify the hardware shapes available in each region. For the recommended dedicated AI cluster unit shapes for each imported model, see Compatible Models. The recommended shape can be used as the baseline, but you can use more hardware resources when the model supports them and the shape is available in the region.

To calculate the hourly price for an imported-model cluster, multiply the AI Unit Per Hour price for Oracle Cloud Infrastructure Generative AI - Model Import on the Pricing Page by the AI unit count for the selected shape. If the cluster has more than one replica, also multiply the result by the number of replicas.

For the imported-model workflow, see Managing Imported Models.

The following regional tables show the complete provider-specific unit shape names for models offered by OCI Generative AI for dedicated hosting. To find the AI unit count, remove the provider or model-family prefix and find the remaining hardware unit shape in Hardware Unit Shapes, Service Limits, and AI Unit Counts. For example, use the H100_X2 row to find the AI unit count for Cohere_H100_X2.

The following table lists baseline hardware unit shape names for models in North America. You can specify more replicas of a baseline shape when you create a dedicated AI cluster, or later when you update the cluster.

The following table lists baseline hardware unit shape names for models in South America. You can specify more replicas of a baseline shape when you create a dedicated AI cluster, or later when you update the cluster.

The following table lists baseline hardware unit shape names for models in Europe. You can specify more replicas of a baseline shape when you create a dedicated AI cluster, or later when you update the cluster.

The following table lists baseline hardware unit shape names for models in the Middle East. You can specify more replicas of a baseline shape when you create a dedicated AI cluster, or later when you update the cluster.

The following table lists baseline hardware unit shape names for models in Asia Pacific. You can specify more replicas of a baseline shape when you create a dedicated AI cluster, or later when you update the cluster.