Oracle Cloud Infrastructure Documentation

Creating an External Metastore for a Cluster

Create an external metastore for a Big Data Service cluster.

Data Catalog provides a highly available and scalable metastore for Hive implementations. You can configure this Data Catalog metastore as an external metastore for a Big Data Service cluster.

To create an external metastore configuration for Big Data Service, you must have the permissions and policies to access and manage a valid Data Catalog metastore. For more prerequisites, see Integrating with Data Catalog External Hive Metastore.

Note

When you create an external metastore, the local metastore for the cluster becomes inactive and the new external Data Catalog metastore is activated.
    1. Open the navigation menu and click Analytics & AI. Under Data Lake, click Big Data Service.
    2. Under Compartment, select the compartment that contains the cluster.
    3. In the list of clusters, click the name of the cluster.
    4. On the Cluster details page, under Resources click Metastore configurations.
    5. Click Create external metastore configuration.
    6. In the Create external metastore configuration panel, enter the name of the external Data Catalog metastore that's available in the specified compartment for you to configure.
    7. Select the API key alias you specified when you created an Object Storage API key.
    8. Enter the API key passphrase. You specified this passphrase when you created the API key.
    9. Enter the cluster administrator password for the cluster. You specified this password when you created the cluster.
    10. Click Create.

    After successful creation of the external metastore for the Big Data Service cluster, the local metastore for the cluster becomes inactive and the new external Data Catalog metastore is activated.

  • Use the oci bds bds-metastore-configuration create command and required parameters to create an external metastore.

    oci bds bds-metastore-configuration create --bds-api-key-id <bds_api_key_id> --bds-api-key-passphrase <bds_api_key_passphrase> --bds-instance-id <bds_instance_> --cluster-admin-password <cluster_admin_password> --metastore-id <metastore_id> [OPTIONS]

    For a complete list of flags and variable options for CLI commands, see the Command Line Reference for Big Data.

  • Use the CreateBdsMetastoreConfiguration operation to create an external metastore.