Skip to content

Commit 285162f

Browse files
[SDP] DataflowGraph.reanalyzeFlow
1 parent f0bbed8 commit 285162f

File tree

4 files changed

+19
-5
lines changed

4 files changed

+19
-5
lines changed

docs/declarative-pipelines/DataflowGraph.md

Lines changed: 12 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@
1111
`DataflowGraph` is created when:
1212

1313
* `DataflowGraph` is requested to [reanalyzeFlow](#reanalyzeFlow)
14-
* `GraphRegistrationContext` is requested to [toDataflowGraph](GraphRegistrationContext.md#toDataflowGraph)
14+
* `GraphRegistrationContext` is requested to [convert to a DataflowGraph](GraphRegistrationContext.md#toDataflowGraph)
1515

1616
## reanalyzeFlow { #reanalyzeFlow }
1717

@@ -20,14 +20,22 @@ reanalyzeFlow(
2020
srcFlow: Flow): ResolvedFlow
2121
```
2222

23-
`reanalyzeFlow`...FIXME
23+
`reanalyzeFlow` [finds the upstream datasets](GraphOperations.md#dfsInternal).
24+
25+
`reanalyzeFlow` finds the upstream flows (for the upstream datasets that could be found in the [resolvedFlows](#resolvedFlows) registry).
26+
27+
`reanalyzeFlow` finds the upstream views (for the upstream datasets that could be found in the [view](#view) registry).
28+
29+
`reanalyzeFlow` creates a new (sub)[DataflowGraph](#creating-instance) for the upstream flows, views and a single table (the [destination](Flow.md#identifier) of the given [Flow](Flow.md)).
30+
31+
`reanalyzeFlow` requests the subgraph to [resolve](#resolve) and returns the [ResolvedFlow](ResolvedFlow.md) for the given [Flow](Flow.md).
2432

2533
---
2634

2735
`reanalyzeFlow` is used when:
2836

29-
* `BatchTableWrite` is requested to [executeInternal](BatchTableWrite.md#executeInternal)
30-
* `StreamingTableWrite` is requested to [startStream](StreamingTableWrite.md#startStream)
37+
* `BatchTableWrite` is requested to [executeAsync](FlowExecution.md#executeAsync) (and [executeInternal](BatchTableWrite.md#executeInternal))
38+
* `StreamingTableWrite` is requested to [executeAsync](FlowExecution.md#executeAsync) (and [startStream](StreamingTableWrite.md#startStream))
3139

3240
## Resolve { #resolve }
3341

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,3 @@
1+
# GraphOperations
2+
3+
`GraphOperations` is...FIXME

docs/declarative-pipelines/GraphRegistrationContext.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@
1616

1717
* `DataflowGraphRegistry` is requested to [createDataflowGraph](DataflowGraphRegistry.md#createDataflowGraph)
1818

19-
## Create DataflowGraph { #toDataflowGraph }
19+
## Convert to DataflowGraph { #toDataflowGraph }
2020

2121
```scala
2222
toDataflowGraph: DataflowGraph
Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,3 @@
1+
# ResolvedFlow
2+
3+
`ResolvedFlow` is...FIXME

0 commit comments

Comments
 (0)