Skip to content

Depth-first execution of nodes with an iterable as input (question) #3757

Description

@joey-scanga

Hello,

More of a general question about workflow structure (please forgive me if this is in the docs and I missed this!): let's say you have one IdentityInterface as the input node with an iterable field, and independent subgraphs for each item in the iterable, as in this graph:

       A
B1 B2 ... BN
C1 C2 ... CN
D1 D2 ... DN

can the workflow be configured to have workers execute/traverse each subgraph completely before switching to the next one in topological order? I.e. if N=1000 and you specify 8 workers, can those 8 workers be scheduled to fully execute one of the subgraphs B1 through D1, B2 through D2, ..., B8 through D8 before moving on to B9-D9?

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions