Limits and Limitations for Generative AI Agents
Learn about OCI Generative AI Agents resource limits. See which limits are preset and which can be increased.
Important
By default, each tenancy is limited to two agents, with each agent having access to one knowledge base. You can ingest up to 1,000 files from an OCI Object Storage bucket (your data source) into the knowledge base for the agent to use.
If these numbers are insufficient for your needs:
- See the following table to identify the relevant resource limit names.
- Request an increase in these limits to suit your use cases.
- Limits to Increase by Request
-
Resource Limit Name Default Limit Description Agent agent-count
2 Number of agents that you can create in a tenancy Knowledge base knowledge-base-count
3 Number of knowledge bases that you can create in a tenancy Endpoint agent-endpoint-per-agent-count
3 Number of endpoints that you can create for each agent Number of files in a data source for each ingestion job number-of-files-per-data-source-count
1,000 The maximum number of files that an ingestion job can ingest from a data source to be used in a knowledge base.
- Preset Limits
-
The following table lists the preset resources for each tenancy. These values can't change.
Resource Limitation Description Data source per knowledge base 1 Number of data sources that each knowledge base can have Data source file size 100 MB The maximum size for a file to be ingested Active ingestion job per data source 1 The maximum number of active ingestion jobs (jobs running simultaneously) in a data source Knowledge base per agent 1 Number of knowledge bases that you can add to an agent A session's idle timeout 7 days Idle timeout for an agent's session before Generative AI Agents deletes that session. The default and minimum value is 1 hour. This means that after the lack of activity between the user and agent for 1 hour, the session automatically ends, and the following conversations don't retain the context of the previous conversation. You can set the idle timeout as high as 7 days. Region US Midwest (Chicago) Your tenancy must have the US Midwest (Chicago) region. Generative AI Agents is only available in this region.