Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate "retire dataset" which is blocked and then cannot reactivate #44

Open
glormph opened this issue Sep 8, 2023 · 1 comment
Milestone

Comments

@glormph
Copy link
Member

glormph commented Sep 8, 2023

Somehow there's been datasets where there's been some issue, i.e. bad raw files that lead to crashed convert job, the user gets annoyed and removes the dataset to start over.

  • User presses "retire dataset" which would remove files from active storage.
  • This job is then blocked by crashed convert job
  • when trying to reactivate, it doesn't work
  • proper way out is to remove corrupt files and re-convert
  • but admin needs to remove the crashed job which blocks first

Maybe run 20 convert workers instead, which each take one file per job, then they'd report granularly which files error, somehow the user will have to be able to remove those files, and resolve the crashed jobs, OR do not crash the job but automatically remove it or OK it? But how to report error if job is green? Automatic corrupt file removal? Or message like admin messaging but to the user?

@glormph glormph added the bug label Jan 10, 2024
@glormph glormph added this to the System fixes milestone Apr 2, 2024
@glormph glormph removed the bug label Apr 16, 2024
@glormph
Copy link
Member Author

glormph commented Apr 16, 2024

Not really a bug, but need better UI to show users how to do it

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant