Creating SQL Endpoints

Follow these steps to create a Data Flow SQL endpoint.

• Console
• CLI
• API

• Follow the steps to create a Metastore and set up IAM policies.

  1. On the SQL endpoints page, select Create SQL endpoint. If you need help finding the SQL endpoints page, see Listing SQL Endpoints.
  2. Enter the name of the SQL endpoint in Name.
  3. (Optional) Description enter a description of the SQL Endpoint that you can use to help search for it.
  4. (Optional) Select Enable autoscaling to use autoscaling.
  5. From the Driver shape list, select the shape you want.
     Select the number of OCPUs if you want a different number to the default value. The memory and block volume amounts change.
  6. From the Executor shape list, select the shape you want.
     Select the number of OCPUs if you want a different number to the default value. The memory and block volume amounts change.
  7. Select the minimum number of executors.
  8. Select the maximum number of executors.
  9. Select the metastore. If the metastore is in a different compartment, click Change compartment to select its compartment.
     Note
     
     You must create a metastore in Data Catalog if one doesn't exist.
  10. (Optional) The default managed table location is set automatically using the same default managed table location configured for the metastore.
  11. Set the network configuration, by selecting either Allow secure access from everywhere, or Virtual Cloud Network.
      • If you selected Allow secure access from everywhere and selected Configure access control rules:
        1. Select the IP notation type.
        2. Enter value.
        3. (Optional) Select +Another entry to add more access control rules.
      • If you selected Virtual Cloud Network:
        1. Select the VCN. If the VCN is in a different compartment, select Change compartment to select its compartment.
        2. Select the subnet. If the subnet is in a different compartment, select Change compartment to select its compartment.
        3. (Optional) Enter a host name prefix.
        4. Select the network security group. If the network security group is in a different compartment, select Change compartment to select its compartment.
        5. (Optional) Select +Another Network security group to add more network security groups.
  12. To set an advanced options select Show advanced options.
      The Spark configuration properties are shown. You can change the values for:

      • spark.dynamicAllocation.executorIdleTimeout
      • spark.dynamicAllocation.schedulerBacklogTimeout
      • spark.dataflow.dynamicAllocation.quotaPolicy

      To add another Spark configuration property, select +Another property and enter the Key and value.
  13. (Optional) In the Tags section, add one or more tags to the <resourceType>. If you have permissions to create a resource, then you also have permissions to apply free-form tags to that resource. To apply a defined tag, you must have permissions to use the tag namespace. For more information about tagging, see Resource Tags. If you're not sure whether to apply tags, skip this option or ask an administrator. You can apply tags later.
  14. Select Create SQL endpoint to create the SQL endpoint.

• Use the create command and required parameters to create a SQL endpoint

  oci data-flow sql-endpoint create [OPTIONS]

  For a complete list of parameters and values for CLI commands, see the CLI Command Reference.

• Run the CreateSqlEndpoint operation to create a SQL endpoint.