oci_datascience_pipeline

This resource provides the Pipeline resource in Oracle Cloud Infrastructure Data Science service. Api doc link for the resource: https://docs.oracle.com/iaas/api/#/en/data-science/latest/Pipeline

Example terraform configs related to the resource : https://github.com/oracle/terraform-provider-oci/tree/master/examples/datascience

Creates a new Pipeline.

Example Usage

resource "oci_datascience_pipeline" "test_pipeline" {
	#Required
	compartment_id = var.compartment_id
	project_id = oci_datascience_project.test_project.id
	step_details {
		#Required
		step_name = var.pipeline_step_details_step_name
		step_type = var.pipeline_step_details_step_type

		#Optional

		application_id = oci_dataflow_application.test_application.id=
		depends_on = var.pipeline_step_details_depends_on
		description = var.pipeline_step_details_description
		is_artifact_uploaded = var.pipeline_step_details_is_artifact_uploaded
		job_id = oci_datascience_job.test_job.id
		step_configuration_details {

			#Optional
			command_line_arguments = var.pipeline_step_details_step_configuration_details_command_line_arguments
			environment_variables = var.pipeline_step_details_step_configuration_details_environment_variables
			maximum_runtime_in_minutes = var.pipeline_step_details_step_configuration_details_maximum_runtime_in_minutes
		}
		step_container_configuration_details {
			#Required
			container_type = var.pipeline_step_details_step_container_configuration_details_container_type
			image = var.pipeline_step_details_step_container_configuration_details_image

			#Optional
			cmd = var.pipeline_step_details_step_container_configuration_details_cmd
			entrypoint = var.pipeline_step_details_step_container_configuration_details_entrypoint
			image_digest = var.pipeline_step_details_step_container_configuration_details_image_digest
			image_signature_id = oci_datascience_image_signature.test_image_signature.id
		}
		step_dataflow_configuration_details {

			#Optional
			configuration = var.pipeline_step_details_step_dataflow_configuration_details_configuration
			driver_shape = var.pipeline_step_details_step_dataflow_configuration_details_driver_shape
			driver_shape_config_details {

				#Optional
				cpu_baseline = var.pipeline_step_details_step_dataflow_configuration_details_driver_shape_config_details_cpu_baseline
				memory_in_gbs = var.pipeline_step_details_step_dataflow_configuration_details_driver_shape_config_details_memory_in_gbs
				memory_in_gbs_parameterized = var.pipeline_step_details_step_dataflow_configuration_details_driver_shape_config_details_memory_in_gbs_parameterized
				ocpus = var.pipeline_step_details_step_dataflow_configuration_details_driver_shape_config_details_ocpus
				ocpus_parameterized = var.pipeline_step_details_step_dataflow_configuration_details_driver_shape_config_details_ocpus_parameterized
			}
			executor_shape = var.pipeline_step_details_step_dataflow_configuration_details_executor_shape
			executor_shape_config_details {

				#Optional
				cpu_baseline = var.pipeline_step_details_step_dataflow_configuration_details_executor_shape_config_details_cpu_baseline
				memory_in_gbs = var.pipeline_step_details_step_dataflow_configuration_details_executor_shape_config_details_memory_in_gbs
				memory_in_gbs_parameterized = var.pipeline_step_details_step_dataflow_configuration_details_executor_shape_config_details_memory_in_gbs_parameterized
				ocpus = var.pipeline_step_details_step_dataflow_configuration_details_executor_shape_config_details_ocpus
				ocpus_parameterized = var.pipeline_step_details_step_dataflow_configuration_details_executor_shape_config_details_ocpus_parameterized
			}
			logs_bucket_uri = var.pipeline_step_details_step_dataflow_configuration_details_logs_bucket_uri
			num_executors = var.pipeline_step_details_step_dataflow_configuration_details_num_executors
			warehouse_bucket_uri = var.pipeline_step_details_step_dataflow_configuration_details_warehouse_bucket_uri
		}
		step_infrastructure_configuration_details {

			#Optional
			block_storage_size_in_gbs = var.pipeline_step_details_step_infrastructure_configuration_details_block_storage_size_in_gbs
			block_storage_size_in_gbs_parameterized = var.pipeline_step_details_step_infrastructure_configuration_details_block_storage_size_in_gbs_parameterized
			shape_config_details {

				#Optional
				cpu_baseline = var.pipeline_step_details_step_infrastructure_configuration_details_shape_config_details_cpu_baseline
				memory_in_gbs = var.pipeline_step_details_step_infrastructure_configuration_details_shape_config_details_memory_in_gbs
				memory_in_gbs_parameterized = var.pipeline_step_details_step_infrastructure_configuration_details_shape_config_details_memory_in_gbs_parameterized
				ocpus = var.pipeline_step_details_step_infrastructure_configuration_details_shape_config_details_ocpus
				ocpus_parameterized = var.pipeline_step_details_step_infrastructure_configuration_details_shape_config_details_ocpus_parameterized
			}
			shape_name = oci_core_shape.test_shape.name
			subnet_id = oci_core_subnet.test_subnet.id
		}
		step_parameters {
			#Required
			output {
				#Required
				output_file = var.pipeline_step_details_step_parameters_output_output_file
				output_parameter_type = var.pipeline_step_details_step_parameters_output_output_parameter_type
				parameter_names = var.pipeline_step_details_step_parameters_output_parameter_names
			}
			parameter_type = var.pipeline_step_details_step_parameters_parameter_type
		}
		step_run_name = var.pipeline_step_details_step_run_name
		step_storage_mount_configuration_details_list {
			#Required
			destination_directory_name = var.pipeline_step_details_step_storage_mount_configuration_details_list_destination_directory_name
			storage_type = var.pipeline_step_details_step_storage_mount_configuration_details_list_storage_type

			#Optional
			bucket = var.pipeline_step_details_step_storage_mount_configuration_details_list_bucket
			destination_path = var.pipeline_step_details_step_storage_mount_configuration_details_list_destination_path
			export_id = oci_file_storage_export.test_export.id
			mount_target_id = oci_file_storage_mount_target.test_mount_target.id
			namespace = var.pipeline_step_details_step_storage_mount_configuration_details_list_namespace
			prefix = var.pipeline_step_details_step_storage_mount_configuration_details_list_prefix
		}
	}

	#Optional
	configuration_details {
		#Required
		type = var.pipeline_configuration_details_type

		#Optional
		command_line_arguments = var.pipeline_configuration_details_command_line_arguments
		environment_variables = var.pipeline_configuration_details_environment_variables
		maximum_runtime_in_minutes = var.pipeline_configuration_details_maximum_runtime_in_minutes
	}
	defined_tags = {"Operations.CostCenter"= "42"}
	description = var.pipeline_description
	display_name = var.pipeline_display_name
	freeform_tags = {"Department"= "Finance"}
	infrastructure_configuration_details {
		#Required
		block_storage_size_in_gbs = var.pipeline_infrastructure_configuration_details_block_storage_size_in_gbs
		shape_name = oci_core_shape.test_shape.name

		#Optional
		block_storage_size_in_gbs_parameterized = var.pipeline_infrastructure_configuration_details_block_storage_size_in_gbs_parameterized
		shape_config_details {

			#Optional
			cpu_baseline = var.pipeline_infrastructure_configuration_details_shape_config_details_cpu_baseline
			memory_in_gbs = var.pipeline_infrastructure_configuration_details_shape_config_details_memory_in_gbs
			memory_in_gbs_parameterized = var.pipeline_infrastructure_configuration_details_shape_config_details_memory_in_gbs_parameterized
			ocpus = var.pipeline_infrastructure_configuration_details_shape_config_details_ocpus
			ocpus_parameterized = var.pipeline_infrastructure_configuration_details_shape_config_details_ocpus_parameterized
		}
		subnet_id = oci_core_subnet.test_subnet.id
	}
	log_configuration_details {

		#Optional
		enable_auto_log_creation = var.pipeline_log_configuration_details_enable_auto_log_creation
		enable_logging = var.pipeline_log_configuration_details_enable_logging
		log_group_id = oci_logging_log_group.test_log_group.id
		log_id = oci_logging_log.test_log.id
	}
	parameters = var.pipeline_parameters
	storage_mount_configuration_details_list {
		#Required
		destination_directory_name = var.pipeline_storage_mount_configuration_details_list_destination_directory_name
		storage_type = var.pipeline_storage_mount_configuration_details_list_storage_type

		#Optional
		bucket = var.pipeline_storage_mount_configuration_details_list_bucket
		destination_path = var.pipeline_storage_mount_configuration_details_list_destination_path
		export_id = oci_file_storage_export.test_export.id
		mount_target_id = oci_file_storage_mount_target.test_mount_target.id
		namespace = var.pipeline_storage_mount_configuration_details_list_namespace
		prefix = var.pipeline_storage_mount_configuration_details_list_prefix
	}
}

Argument Reference

The following arguments are supported:

** IMPORTANT ** Any change to a property that does not support update will force the destruction and recreation of the resource with the new property values

Attributes Reference

The following attributes are exported:

Timeouts

The timeouts block allows you to specify timeouts for certain operations: * create - (Defaults to 20 minutes), when creating the Pipeline * update - (Defaults to 20 minutes), when updating the Pipeline * delete - (Defaults to 20 minutes), when destroying the Pipeline

Import

Pipelines can be imported using the id, e.g.

$ terraform import oci_datascience_pipeline.test_pipeline "id"