Limits and Limitations for Generative AI Agents

Learn about OCI Generative AI Agents resource limits. See which limits are preset and which can be increased.

Important

By default, each tenancy is limited to two agents, with each agent having access to one knowledge base. You can ingest up to 1,000 files from an OCI Object Storage bucket (your data source) into the knowledge base for the agent to use.

If these numbers are insufficient for your needs:

  1. See the following table to identify the relevant resource limit names.
  2. Request an increase in these limits to suit your use cases.
Limits to Increase by Request
Resource Limit Name Default Limit Description
Agent agent-count 2 Number of agents that you can create in a tenancy
Knowledge base knowledge-base-count 3 Number of knowledge bases that you can create in a tenancy
Endpoint agent-endpoint-per-agent-count 3 Number of endpoints that you can create for each agent
Number of files in a data source for each ingestion job number-of-files-per-data-source-count 1,000

The maximum number of files that an ingestion job can ingest from a data source to be used in a knowledge base.

Preset Limits

The following table lists the preset resources for each tenancy. These values can't change.

Resource Limitation Description
Data source per knowledge base 1 Number of data sources that each knowledge base can have
Data source file size 100 MB The maximum size for a file to be ingested
Active ingestion job per data source 1 The maximum number of active ingestion jobs (jobs running simultaneously) in a data source
Knowledge base per agent 1 Number of knowledge bases that you can add to an agent
A session's idle timeout 7 days Idle timeout for an agent's session before Generative AI Agents deletes that session. The default and minimum value is 1 hour. This means that after the lack of activity between the user and agent for 1 hour, the session automatically ends, and the following conversations don't retain the context of the previous conversation. You can set the idle timeout as high as 7 days.
Region US Midwest (Chicago) Your tenancy must have the US Midwest (Chicago) region. Generative AI Agents is only available in this region.