Skip to content
This repository has been archived by the owner on Nov 9, 2022. It is now read-only.

Batch job support #91

Open
aclavio opened this issue Jul 1, 2020 · 2 comments
Open

Batch job support #91

aclavio opened this issue Jul 1, 2020 · 2 comments
Labels
enhancement New feature or request
Milestone

Comments

@aclavio
Copy link
Contributor

aclavio commented Jul 1, 2020

Currently a state conductor "job" or "execution" is scoped to a single URI. However it may be desirable for this execution to contain a batch of URIs. This implies that each document in these batches will move through the applicable states as a group, and will fail or commit each transaction together. The action and condition modules will need to accept or anticipate the possibility of processing multiple documents at once.

@aclavio
Copy link
Contributor Author

aclavio commented Jul 1, 2020

One possible implementation involves removing the "uri" from the job document's root level, and simply reloading into the job's context as a "uri" parameter. Then batches could utilize a "uris"/"batch" array parameter in the context instead. This should work in the case where no uri is passed at all (as in the case of "periodic" flows).

The action modules' "performAction" and condition modules' "checkCondition" function signature would need to be changed; and implementors would need to expect the relevant values to be present in the passed context.

@aclavio aclavio added this to the Backlog milestone Jul 1, 2020
@aclavio aclavio added the enhancement New feature or request label Jul 1, 2020
@freshie
Copy link
Contributor

freshie commented Jul 1, 2020

I think removing the URI makes sense.

I think we could use the context to put data in there.

The data would change depending on the type of context.

we'd want it to be backwords compatible

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants