Oracle Cloud Infrastructure Documentation

Help Sheet - Prepare for Disk Import Jobs

Use this help sheet to preparing and running your disk import job.

Preparing

  1. Ensure you have the following set up in your environment:

    • USB 2.0/3.0 external hard disk drive (disk) to be used as your import disk.

    • Computer running one of the following Linux operating systems:

      • Oracle Linux 6 or greater

      • Ubuntu 14.04 or greater

      • SUSE 11 or greater

      All Linux operating systems must have the ability to create an EXT file system. Make sure the system has the following installed:

      • Java 1.8 or Java 1.11

      • hdparm 9.0 or later

      • Cryptsetup 1.2.0 or greater

  2. Download and install the Data Transfer Utility on the Linux machine where the data will be copied from and the disk will be mounted. You should have root access to this machine.

    Installation instructions are located at: Preparing for Disk Data Transfers.

  3. Install OCI Command Line Interface on the Linux machine where the data will be copied from and the disk will be mounted. You should have root access to this Linux machine.

    Installation instructions are located at: Install CLI.

  4. On the machine where data will be copied from generate public/private keys for the user(s) who will do the data copy, run the following command: 

    oci setup keys

    See Required Keys and OCIDs for more information on keys.

  5. Login to OCI with an Administrative user for the tenancy.

  6. Create the user policies. Ensure that the policies include the following:

    Allow group group_name to {DTA_ENTITLEMENT_CREATE} in tenancy

    See Managing Policies for more information on policies

  7. Create a compartment where the transfer job and landing bucket will reside.

    See Managing Compartments for more information on compartments.

  8. Create the necessary user accounts for those individuals who will copy data to the disk. Include the public key that was previously generated.

    See Managing Users for more information on users.

    See Required Keys and OCIDs for more information on public keys.

  9. Create a group for the user who will copy data to the disk. Include the following policies in the group:

    Allow group group_name to manage data-transfer-jobs in compartment compartment_name
Allow group group_name to manage buckets in compartment compartment_name
Allow group group_name to manage objects in compartment compartment_name

    See Managing Groups for more information on groups.

    If you want to include notifications for the group, includes these additional policies:

    Allow group group name to manage ons-topics in tenancy
Allow group group name to manage ons-subscriptions in tenancy
Allow group group name to manage cloudevents-rules in tenancy
Allow group group name to inspect compartments in tenancy

    See Notifications for more information on notifications.

    See Overview of Events for more information on events.

  10. Create an upload user for Oracle personnel to upload data into the bucket.

    See Managing Users for more information on users.

  11. Create a group for the upload user, and include the public key that was previously generated.

    See Managing Groups for more information on groups.

    See Required Keys and OCIDs for more information on public keys.

  12. Add the following policies for the upload user group:

    Allow group group_name to manage buckets in compartment compartment_name where all { request.permission='BUCKET_READ', target.bucket.name='bucket_name' }
Allow group group_name to manage objects in compartment compartment_name where all { target.bucket.name='bucket_name', any { request.permission='OBJECT_CREATE', request.permission='OBJECT_OVERWRITE', request.permission='OBJECT_INSPECT' }}

    The permissions for upload users allow Oracle personnel to upload standard and multi-part objects on your behalf and inspect bucket and object metadata. The permissions do not allow Oracle personnel to inspect the actual data.

    See Managing Policies for more information on policies

  13. Open firewall to OCI Data Transfer Service on the IP address ranges:

    140.91.0.0/16

  14. Open firewall to OCI Object Storage IP address ranges:

    134.70.0.0/17

Creating the Transfer Job

Run these command line items on the host where you plan on mounting USB HDD and copying data and/or the host that you will use to manage the data transfer job:

  1. As root, create the configuration files:

    sudo bash
mkdir /root/.oci
cd /root/.oci
vi config
[DEFAULT]
user=<The OCID for the data transfer administrator>
fingerprint=<The fingerprint of the above user's public key>
key_file=<The _absolute_ path to the above user's private key file on the host machine>
tenancy=<The OCID for the tenancy that owns the data transfer job and bucket>
region=<The region where the transfer job and bucket should exist. Valid values are: 
us-ashburn-1, us-phoenix-1, eu-frankfurt-1, and uk-london-1.>

vi config_upload_user
[DEFAULT]
user=<The OCID for the data transfer upload user>
fingerprint=<The fingerprint of the above user's public key>
key_file=<The _absolute_ path to the above user's private key file on the host machine>
tenancy=<The OCID for the tenancy that owns the data transfer job and bucket>
region=<The region where the transfer job and bucket should exist. Valid values are: 
us-ashburn-1, us-phoenix-1, eu-frankfurt-1, and uk-london-1.>
endpoint=https://objectstorage.<region information>.com

  2. Get the tenancy namespace:

    oci os ns get

  3. Create a bucket in the compartment created for the transfer job

    oci os bucket create –namespace object_storage_namespace --name bucket name --compartment-id compartment_id

  4. Verify the data transfer upload user credentials:

    dts job verify-upload-user-credentials --bucket bucket_name

  5. Create the transfer job:

    dts job create -–bucket bucket_name --compartment-id compartment_id --display-name display_name

    The job OCID is displayed in the Data Transfer Utility return after you create the job. Send this job OCID to the person who will copy data to the disk.

  6. (Optional) Add notifications:

    oci dts job setup-notifications --job-id job_id

  7. Create a virtual representation of the physical shipping package for the disk called a transfer package:

    dts package create --job-id job_id

  8. Get the package label:

    dts job show --job-id job_id

    The package label is included in the Data Transfer Utility return. Send it to the person who will copy data to the disk.

  9. Get the shipping address for the disk:

    dts package show --job-id job_id --package-label package_label

    Shipping information is included in the Data Transfer Utility return. Send it to the person who will create the shipping labels.

  10. Create a FedEx, UPS, or DHL shipping label for the disk using the address from above to ship the disk to Oracle. Send the carrier-provided tracking to the person who will copy data to the disk.

  11. Create a return label for the disk and send it electronically or in person to the person who will ship the disk. Send the tracking number for the return label to the person who will copy data to the disk.