Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Machine crash kills slurm jobs, but temp files will still show running job #5307

Open
ryan-preble opened this issue Feb 6, 2025 · 0 comments · May be fixed by #5333
Open

Machine crash kills slurm jobs, but temp files will still show running job #5307

ryan-preble opened this issue Feb 6, 2025 · 0 comments · May be fixed by #5333
Assignees
@ryan-preble
Labels
Priority: Normal Status: Discussion Required Issue needs further discussion before continuing.

Comments

@ryan-preble
Copy link
Contributor

In the edge case that the server crashes while slurm jobs are running, the slurm jobs will be cancelled but the user details page will show them as "in progress" perpetually. There should be a check to clean up temp files for analyses that are no longer running but may not have sucessfully finished.
@ryan-preble ryan-preble self-assigned this Feb 6, 2025
@lukasmueller lukasmueller added Priority: Normal Status: Discussion Required Issue needs further discussion before continuing. labels Feb 10, 2025
@ryan-preble ryan-preble linked a pull request Feb 17, 2025 that will close this issue
Open
15 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ryan-preble ryan-preble

Labels
Priority: Normal Status: Discussion Required Issue needs further discussion before continuing.
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Topic/fix dead slurm job cache solgenomics/sgn
2 participants
@lukasmueller @ryan-preble