Using Data Pipelines for Continuous Load and Export
Data pipelines allow you to repeatedly load data from object store or export data to object store. Load pipelines provide continuous incremental data loading from external sources (as data arrives on object store it is loaded to a database table). Export pipelines provide continuous incremental data exporting to object store (as new data appears in a database table it is exported to object store).
- About Data Pipelines on Autonomous Database
Autonomous Database data pipelines are either load pipelines or export pipelines. - Create and Configure Pipelines
You can create one or more load or export pipelines. When you create a pipeline, you use parameters and set pipeline attributes to configure the pipeline. - Test Pipelines
UseRUN_PIPELINE_ONCE
to run a pipeline once on-demand without creating a scheduled job. - Control Pipelines (Start, Stop, Drop, or Reset a Pipeline)
After you create and test a pipeline, you control a pipeline by starting, stopping, or dropping the pipeline. You can also reset a pipeline. - Monitor and Troubleshoot Pipelines
All pipelines that are created are logged in theDBMS_CLOUD_PIPELINE
views. - Use Oracle Maintained Pipelines
Autonomous Database provides built-in pipelines. These pipelines are preconfigured and can be started by the ADMIN user. Oracle Maintained pipelines are owned by ADMIN user.
Parent topic: Load Data into Autonomous Database