Monitoring the Import Appliance and Data Transfer

The shipping vendor notifies Oracle when your import appliance is picked up and shipped back for upload to Oracle Cloud Infrastructure Object Storage.

Oracle creates upload summary log files for each uploaded appliance. These log files are placed in the bucket where data was uploaded to Oracle Cloud Infrastructure. The upload summary file compares the appliance's manifest file to the contents of the target Oracle Cloud Infrastructure Object Storage bucket after file upload.

The top of the log report summarizes the overall file processing status:

P - Present: The file is present in both the device and the target bucket
M - Missing: The file is present in the device but not the target bucket. It was likely uploaded and then deleted by another user before the summary was generated.
C - Name Collision: The file is present in the manifest but a file with the same name but different contents is present in the target bucket.
U - Unreadable: The file is not readable from the disk
N - Name Too Long: The file name on disk is too long and could not be uploaded

Complete file upload details follow the summary.

If you upload more than 100,000 files, the upload details are broken into multiple pages. You can only download the first page from the Console. Download the rest of the pages directly from the Object Storage bucket. The subsequent pages have the same object name as the first page, but have an enumerated suffix.

oci os object get --namespace object_storage_namespace --bucket-name bucket_name --name object_name --file file_location

oci os object get --namespace MyNamespace --bucket-name MyBucket1 --name JLA12B3C/XAABC12EFG/upload_summary.txt –file upload_summary.txt
		
Downloading object  [####################################]  100%

oci os object get --namespace object_storage_namespace --bucket-name bucket_name --name object_name --file file_location

oci os object get --namespace example_namespace --bucket-name bucket-1 --name file_1.txt –file file_1.txt
		
Downloading object  [####################################]  100%

python -c 'print "BASE64-ENCODED-MD5-VALUE".decode("base64").encode("hex")'

python -c 'print "EoN8s6dgT/9pGYA7Yx1klQ==".decode("base64").encode("hex")'
		
12837cb3a7604fff6919803b631d6495

md5sum file_name

md5sum file_1.txt
		
12837cb3a7604fff6919803b631d6495  file_1.txt

After the import appliance with your copied data is received by Oracle and the data transfer begins, you can view the metrics associated with the transfer job in the Transfer Appliance Details page in chart or table format.

Select Metrics under Resources to display each of these measures:

• Import Files Uploaded: Total number of files uploaded for import.

• Import Bytes Uploaded: Total number of bytes uploaded for import.

• Import Files Remaining: Total number of files remaining for import upload.

• Import Bytes Remaining: Total number of bytes remaining for import upload.

• Import Files in Error: Total number of files in error for import.

• Import Upload Verification Progress: Progress of verification of files that have already been uploaded for import.

Select the Start Time and End Time for these measures, either by manually entering the days and times in their respective fields, or by selecting the Calendar feature and picking the times that way. As an alternative to selecting a start and end time, you can also select from a list of standard times (last hour, last 6 hours, and so forth) from the Quick Selects list for the period measured. The time period you specify applies to all the measures.

Specify the Interval (for example, 5 minutes, 1 hour) that each measure is recorded from the list.

Specify the Statistic being recorded (for example, Sum, Mean) for each measure from the list.

Choose additional actions from the Options list, including viewing the query in the Metrics Explorer, capturing the URL for the measure, and switching between chart and table view.

Click Reset Charts to delete any existing information in the charts and begin recording new metrics.

See Monitoring for general information on monitoring your Oracle Cloud Infrastructure services.

Close the transfer job when no further transfer job activity is required or possible. Closing a transfer job requires that the status of all associated import appliances be returned, canceled, or deleted.

Perform the following command line interface (CLI) validation tasks at the end of this phase before continuing to the next phase. Performing the validation procedures described here assesses your environment and confirms that you have completed all necessary setup requirements successfully. Running these procedures also serves as a troubleshooting resource for you to ensure a smooth and successful data transfer.

Use the oci dts verify monitored command and required parameters to validate the Monitoring phase tasks and configurations you made:

oci dts verify monitored --job-id job_ocid --appliance-label appliance_label [OPTIONS]

Running this CLI command validates the following: Healthy import appliance status.

For a complete list of flags and variable options for CLI commands, see the Command Line Reference.

For example:

oci dts verify monitored --job-id ocid1.datatransferjob.oc1..exampleuniqueID --appliance-label XAKWEGKZ5T
Verifying requirements after 'Monitoring the Import Appliance and Data Transfer'...
Checking Import Appliance Status... OK
Oracle completed your import appliance data upload. Your data is available in your designated bucket in Oracle 
Cloud Infrastructure Object Storage.
Verification successful.

You have completed the process of setting up, running, and monitoring the Appliance-Based Data Import. If you determine that another appliance-based data transfers is required, repeat the procedure from the beginning.