Receive Notifications for Data Catalog Harvest Events
In this tutorial, you set up the Oracle Cloud Infrastructure Events service to send you an email whenever a Data Catalog harvest job starts, succeeds, or fails in a specific compartment. Key tasks include how to:
- Create topics and subscriptions.
- Write rules to receive email notifications for events.
- Create buckets with data.
- Harvest data in Data Catalog.
Before You Begin
To successfully perform this tutorial, you must have:
- An Oracle Cloud Infrastructure account. See Request and Manage Free Oracle Cloud Promotions.
- Two images ready to add to your bucket later:
<image-01>
<image-02>
allow group <the-group-your-username-belongs> to manage all-resources in compartment catalog-compartment
See Common Policies for more examples.
In the next section, you make a compartment for your data catalog instances, called
catalog-compartment
.1. Set Up a Notification
In this section, you set up the Notifications service to register your email for a custom subscription. Later, you use this subscription, to receive notifications in your email account.
Create a compartment for data catalog instances, events, and notifications.
You have successfully created a compartment for your data catalog resources.
2. Set Up an Event Rule
In this section, you set up a rule in the Events service to send you an email whenever a harvest job starts, succeeds or fails in your compartment.
3. Create a Bucket with Data
In this section, you create a bucket in the Object Storage service. Then you add data to the bucket.
Create a bucket in the Object Storage service.
catalog-compartment
. This policy allows your data catalog instances to download metadata from the catalog-bucket
.4. Harvest the Bucket
In this section, you create a data catalog instance. Then you connect your data catalog instance to your bucket and harvest metadata from the bucket. Finally, you review your email notifications for the harvest jobs.
Prepare the information you need and copy them into a notepad.
Collect the following information from the Console:
- Compartment ID:
<compartment-ocid>
- In the Console search bar, enter
catalog-compartment
. - Click
catalog-compartment
in the search results. - Copy the OCID.
- In the Console search bar, enter
- (OCI) Region:
<region-identifier>
- From the top navigation bar, find
<your-region>
. Example:US West (Phoenix)
. - On the top navigation bar, go to your Profile icon and click
Tenancy: <your tenancy>
. - Click Manage Regions.
- In the list of regions, find the
<region-identifier>
for<your-region>
. Example:us-phoenix-1
.
- From the top navigation bar, find
- URL:
<object-storage-swift-URI>
- Copy the following string:
https://swiftobjectstorage.<region-identifier>.oraclecloud.com
- Replace
<region-identifier>
with the information you gathered for Region.
- Copy the following string:
- Namespace:
<object-storage-namespace>
- In the top navigation bar, go to your Profile icon and click
Tenancy: <your tenancy>
. - Copy the value for Object Storage Namespace.
- In the top navigation bar, go to your Profile icon and click
catalog-bucket
to
catalog-instance-1
.What's Next
Congratulations! You successfully received two notification emails, one when a harvest job started and one when it completed.