Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add ability to skip tasks on restart/replay #6711

Open
paulgrainger85 opened this issue Jan 10, 2025 · 0 comments
Open

Add ability to skip tasks on restart/replay #6711

paulgrainger85 opened this issue Jan 10, 2025 · 0 comments
Labels
area/backend Needs backend code changes area/frontend Needs frontend code changes enhancement New feature or request kind/customer-request Requested by one or more customers

Comments

@paulgrainger85
Copy link

Feature description

A use-case I have encountered is the following

  • A user has a long-running flow which requires a lot of pre-processing data
  • A non-critical task in the flow causes it to fail - say a data quality check which fails due to a false positive.
  • User is now unable to complete the flow because it is not possible to get past this failed check

There are of course ways to prevent this in the first place (e.g. using human in the loop).

However, another option for users would be the ability to mark certain tasks as skippable then replaying. E.g.

  • The above flow runs and fails due to a bad data quality check
  • The user marks the data quality task as "SKIP" and replays the flow from this task
  • The flow proceeds as if the data quality task had succeeded.

Certain tasks and flows will not be compatible with this, such as tasks which produce outputs that are used elsewhere in the flow, but there need not be guards placed around that as a user should understand the risk of skipping a task.

@paulgrainger85 paulgrainger85 added area/backend Needs backend code changes enhancement New feature or request area/frontend Needs frontend code changes kind/customer-request Requested by one or more customers labels Jan 10, 2025
@github-project-automation github-project-automation bot moved this to Backlog in Issues Jan 10, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/backend Needs backend code changes area/frontend Needs frontend code changes enhancement New feature or request kind/customer-request Requested by one or more customers
Projects
Status: Backlog
Development

No branches or pull requests

1 participant