You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/source/user_guide/pipeline/overview.rst
+4-4
Original file line number
Diff line number
Diff line change
@@ -1,20 +1,20 @@
1
1
Overview
2
2
********
3
3
4
-
Oracle Cloud Infrastructure (OCI) Data Science Machine Learning (ML) Pipeline enables you to define and run an end-to-end machine learning orchestration covering all the steps of machine learning lifecycle that can be executed in a repeatable, continuous ML pipeline.
4
+
Oracle Cloud Infrastructure (OCI) Data Science Machine Learning (ML) Pipelines lets you define and run an end-to-end machine learning orchestration covering all the steps of machine learning lifecycle that can be executed in a repeatable, continuous ML pipeline.
5
5
6
-
Machine learning lifecycle is composed of data acquisition and extraction, data preparation, featurization, training model including algorithm selection and hyper-parameter tuning, model evaluation, deployment, and then monitoring the deployed model and retraining.
6
+
The machine learning lifecycle is composed of several steps: data acquisition and extraction, data preparation, featurization, model training including algorithm selection and hyper-parameter tuning, model evaluation, deployment, and finally monitoring the deployed model and possible retraining.
7
7
8
8
9
9
Pipeline Step
10
10
=============
11
11
12
-
Pipeline step is a task in a pipeline. A pipeline step can be either a Data Science Job step or a Custom Script step.
12
+
A pipeline step is a task in a pipeline. A pipeline step can be either a Data Science Job step or a Custom Script step.
13
13
14
14
Pipeline
15
15
========
16
16
17
-
A pipeline is a workflow of tasks, called steps. Steps can run in sequence or in parallel, creating a Directed Acyclic Graph (DAG) of the steps.
17
+
A pipeline is a workflow of tasks, called steps. Steps can run in sequence or in parallel resulting in a Directed Acyclic Graph (DAG) of the steps.
18
18
19
19
In a machine learning context, ML Pipelines provide a workflow of data import, data transformation, model training, and model evaluation.
Copy file name to clipboardExpand all lines: docs/source/user_guide/pipeline/pipeline.rst
+17-17
Original file line number
Diff line number
Diff line change
@@ -196,21 +196,21 @@ You can call the ``run()`` method of the ``Pipeline`` instance to launch a new P
196
196
It returns a ``PipelineRun`` instance.
197
197
198
198
199
-
The ``.run()`` method gives you the option to override the configurations in a pipeline run. It takes the following optional parameters:
199
+
The ``run()`` method gives you the option to override the configurations in a pipeline run. It takes the following optional parameters:
200
200
201
-
- ``display_name: str, optional``. Defaults to ``None``. The display name of the run.
202
-
- ``project_id: str, optional``. Defaults to ``None``. The project id to override the one defined previously.
203
-
- ``compartment_id: str, optional``. Defaults to ``None``. The compartment id to override the one defined previously.
204
-
- ``configuration_override_details: dict, optional``. Defaults to ``None``. The configuration details dictionary to override the one defined previously. The ``configuration_override_details`` contains the following keys:
201
+
- ``display_name: str, optional``. Defaults to ``None``. The display name of the run.
202
+
- ``project_id: str, optional``. Defaults to ``None``. The project id to override the one defined previously.
203
+
- ``compartment_id: str, optional``. Defaults to ``None``. The compartment id to override the one defined previously.
204
+
- ``configuration_override_details: dict, optional``. Defaults to ``None``. The configuration details dictionary to override the one defined previously. The ``configuration_override_details`` contains the following keys:
205
205
``type``: str, only ``DEFAULT`` is allowed;
206
206
``environment_variables``: dict, the environment variables;
207
207
``command_line_arguments``: str, the command line arguments;
208
208
``maximum_runtime_in_minutes``: int, the maximum runtime allowed in minutes.
209
-
- ``log_configuration_override_details: dict, optional``. Defaults to ``None``. The log configuration details dictionary to override the one defined previously.
210
-
- ``step_override_details: list[PipelineStepOverrideDetails], optional``. Defaults to ``None``. The step details list to override the one defined previously.
211
-
- ``free_form_tags: dict(str, str), optional``. Defaults to ``None``. The free from tags dictionary to override the one defined previously.
212
-
- ``defined_tags: dict(str, dict(str, object)), optional``. Defaults to ``None``. The defined tags dictionary to override the one defined previously.
213
-
- ``system_tags: dict(str, dict(str, object)), optional``. Defaults to ``None``. The system tags dictionary to override the one defined previously.
209
+
- ``log_configuration_override_details: dict, optional``. Defaults to ``None``. The log configuration details dictionary to override the one defined previously.
210
+
- ``step_override_details: list[PipelineStepOverrideDetails], optional``. Defaults to ``None``. The step details list to override the one defined previously.
211
+
- ``free_form_tags: dict(str, str), optional``. Defaults to ``None``. The free from tags dictionary to override the one defined previously.
212
+
- ``defined_tags: dict(str, dict(str, object)), optional``. Defaults to ``None``. The defined tags dictionary to override the one defined previously.
213
+
- ``system_tags: dict(str, dict(str, object)), optional``. Defaults to ``None``. The system tags dictionary to override the one defined previously.
214
214
215
215
.. code-block:: python3
216
216
@@ -233,11 +233,11 @@ Use the ``from_ocid()`` method from the ``Pipeline`` class to load an existing p
233
233
Visualize
234
234
=========
235
235
236
-
Use the ``.show()`` method on the ``Pipeline`` instance to visualize the pipeline in a graph.
236
+
Use the ``show()`` method on the ``Pipeline`` instance to visualize the pipeline in a graph.
237
237
238
-
The ``.show()`` method takes the following optional parameter:
238
+
The ``show()`` method takes the following optional parameter:
239
239
240
-
- ``rankdir: (str, optional)``. Defaults to ``TB``. The allowed values are ``TB`` or ``LR``. This parameter is applicable only for ``graph`` mode and it renders the direction of the graph as either top to bottom (TB) or left to right (LR).
240
+
- ``rankdir: (str, optional)``. Defaults to ``TB``. The allowed values are ``TB`` or ``LR``. This parameter is applicable only for ``graph`` mode and it renders the direction of the graph as either top to bottom (TB) or left to right (LR).
241
241
242
242
243
243
.. code-block:: python3
@@ -252,11 +252,11 @@ Below is an example of the output.
252
252
Delete
253
253
======
254
254
255
-
Use the ``.delete()`` method on the ``Pipeline`` instance to delete a pipeline. It takes the following optional parameters:
255
+
Use the ``delete()`` method on the ``Pipeline`` instance to delete a pipeline. It takes the following optional parameters:
256
256
257
-
- ``delete_related_pipeline_runs: (bool, optional)``. Specify whether to delete related PipelineRuns or not. Defaults to ``True``.
258
-
- ``delete_related_job_runs: (bool, optional)``. Specify whether to delete related JobRuns or not. Defaults to ``True``.
259
-
- ``max_wait_seconds: (int, optional)``. The maximum time to wait, in seconds. Defaults to ``1800``.
257
+
- ``delete_related_pipeline_runs: (bool, optional)``. Specify whether to delete related PipelineRuns or not. Defaults to ``True``.
258
+
- ``delete_related_job_runs: (bool, optional)``. Specify whether to delete related JobRuns or not. Defaults to ``True``.
259
+
- ``max_wait_seconds: (int, optional)``. The maximum time to wait, in seconds. Defaults to ``1800``.
260
260
261
261
A pipeline can only be deleted when its associated pipeline runs are all deleted,
262
262
or alternatively, set the parameter ``delete_related_pipeline_runs`` to delete all associated runs in the same operation.
Copy file name to clipboardExpand all lines: docs/source/user_guide/pipeline/pipeline_run.rst
+11-11
Original file line number
Diff line number
Diff line change
@@ -11,13 +11,13 @@ With a ``PipelineRun`` instance, you can watch the status of the run and stream
11
11
Watch status
12
12
============
13
13
14
-
Use the ``.show()`` method of the ``PipelineRun`` instance to watch the status of pipeline run.
14
+
Use the ``show()`` method of the ``PipelineRun`` instance to watch the status of pipeline run.
15
15
16
-
The ``.show()`` method takes the following optional parameter:
16
+
The ``show()`` method takes the following optional parameter:
17
17
18
-
- ``mode: (str, optional)``. Defaults to ``graph``. The allowed values are ``text`` or ``graph``. This parameter renders the current status of pipeline run as either ``text`` or ``graph``.
19
-
- ``wait: (bool, optional)``. Defaults to ``False`` and it only renders the current status of each step run in graph. If set to ``True``, it renders the current status of each step run until the entire pipeline is complete.
20
-
- ``rankdir: (str, optional)``. Defaults to ``TB``. The allowed values are ``TB`` or ``LR``. This parameter is applicable only for ``graph`` mode and it renders the direction of the graph as either top to bottom (TB) or left to right (LR).
18
+
- ``mode: (str, optional)``. Defaults to ``graph``. The allowed values are ``text`` or ``graph``. This parameter renders the current status of pipeline run as either ``text`` or ``graph``.
19
+
- ``wait: (bool, optional)``. Defaults to ``False`` and it only renders the current status of each step run in graph. If set to ``True``, it renders the current status of each step run until the entire pipeline is complete.
20
+
- ``rankdir: (str, optional)``. Defaults to ``TB``. The allowed values are ``TB`` or ``LR``. This parameter is applicable only for ``graph`` mode and it renders the direction of the graph as either top to bottom (TB) or left to right (LR).
21
21
22
22
To watch the live update of each step run status in text until the entire pipeline is complete
23
23
@@ -49,8 +49,8 @@ Below is an example of the output.
49
49
Monitor Logs
50
50
============
51
51
52
-
Use the ``.watch()`` method on the ``PipelineRun`` instance to stream the service, custom, or consolidated log of the pipeline run.
53
-
The ``.watch()`` method takes the following optional parameters:
52
+
Use the ``watch()`` method on the ``PipelineRun`` instance to stream the service, custom, or consolidated log of the pipeline run.
53
+
The ``watch()`` method takes the following optional parameters:
54
54
55
55
- ``steps: (list, optional)``. Defaults to ``None`` and streams the log of the pipeline run. If a list of the step names is provided, the method streams the log of the specified pipeline step runs.
56
56
- ``log_type: (str, optional)``. Defaults to ``None``. The allowed values are ``custom_log``, ``service_log``, or ``None``. If ``None`` is provided, the method streams both service and custom logs.
@@ -122,7 +122,7 @@ Use the ``from_ocid()`` method from the ``PipelineRun`` class to load an existin
122
122
Cancel
123
123
======
124
124
125
-
Use the ``.cancel()`` method on the ``PipelineRun`` instance to cancel a pipeline run.
125
+
Use the ``cancel()`` method on the ``PipelineRun`` instance to cancel a pipeline run.
126
126
127
127
Pipeline Runs can only be canceled when they are in the ACCEPTED or IN_PROGRESS state.
128
128
@@ -135,10 +135,10 @@ Pipeline Runs can only be canceled when they are in the ACCEPTED or IN_PROGRESS
135
135
Delete
136
136
======
137
137
138
-
Use the ``.delete()`` method on the ``PipelineRun`` instance to delete a pipeline run. It takes the following optional parameter:
138
+
Use the ``delete()`` method on the ``PipelineRun`` instance to delete a pipeline run. It takes the following optional parameter:
139
139
140
-
- ``delete_related_job_runs: (bool, optional)``. Specify whether to delete related JobRuns or not. Defaults to ``True``.
141
-
- ``max_wait_seconds: (int, optional)``. The maximum time to wait in seconds. Defaults to ``1800``.
140
+
* ``delete_related_job_runs: (bool, optional)``. Specify whether to delete related JobRuns or not. Defaults to ``True``.
141
+
* ``max_wait_seconds: (int, optional)``. The maximum time to wait in seconds. Defaults to ``1800``.
142
142
143
143
Pipeline runs can only be deleted when they are already in a SUCCEEDED, FAILED, or CANCELED state.
0 commit comments