Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Store RTW files in share directory in installed workflow #3600

Conversation

mo-gill
Copy link
Contributor

@mo-gill mo-gill commented May 16, 2024

Description

This PR should successfully store RTW files in the share directory in installed workflows


Checklist

It is the responsibility of the author to make sure the pull request is ready to review. The icons indicate whether the item will be subject to the 🛠 Technical or 🧪 Scientific review.

To help with the number of pull requests:

@mo-gill mo-gill added the Recipe Test Workflow (RTW) Items relevant to the Recipe Test Workflow label May 16, 2024
@mo-gill mo-gill requested a review from ehogan May 16, 2024 14:37
@mo-gill mo-gill self-assigned this May 16, 2024
@mo-gill mo-gill changed the title Store share dir in installed workflow Store RTW files in share directory in installed workflow May 16, 2024
@mo-gill mo-gill marked this pull request as ready for review May 20, 2024 09:27
Copy link
Contributor

@ehogan ehogan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice work @mo-gill, thank you! 🎉

Once you have responded to my review comments, would you ask Alistair to test the changes to ensure it behaves the way he expects, please? (It looks ok to me, but it would be good to get confirmation from Alistair also) 👍

Copy link
Contributor

@ehogan ehogan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @mo-gill! 🥳

@mo-gill mo-gill requested a review from alistairsellar May 21, 2024 10:42
Copy link
Contributor

@alistairsellar alistairsellar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great work @mo-gill !

This does exactly what I was expecting. Example work task for me:

$ export CYLC_VERSION=8
$ cylc vip -O metoffice
# Then let it run / fail on first cycle. I might then change a file in workflow source, although not required for this demo
$ cylc validate-reinstall -O metoffice recipe_test_workflow
<snip>
send rose-suite.conf

NOTE: Files created by Rose file installation will show as deleted.
      They will be re-created during the reinstall process.

TIP: You can "exclude" files/dirs to prevent Cylc from installing or overwriting
     them by adding them to the .cylcignore file. See cylc reinstall --help.

Reinstall would make the above changes.
Continue [y/n]: y
REINSTALLED recipe_test_workflow/run12 from /net/data/users/hadtq/esmvaltool/operate_rtw/ESMValTool/esmvaltool/utils/recipe_test_workflow/recipe_test_workflow
Successfully reinstalled.
<snip>
$ cylc gui
# Go to GUI and trigger individual tasks

Without this branch, the validate-reinstall step deletes essential files, and therefore the triggered tasks fail in the final step. With this branch I was able to successfully trigger tasks and they gave the same results as on the first (=clean) run.

@mo-gill mo-gill merged commit 38a42e6 into recipe_test_workflow_prototype May 21, 2024
10 checks passed
@mo-gill mo-gill deleted the 3434_store_share_dir_in_installed_workflow branch May 21, 2024 11:50
@mo-gill mo-gill linked an issue May 23, 2024 that may be closed by this pull request
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Recipe Test Workflow (RTW) Items relevant to the Recipe Test Workflow
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Store RTW files in share directory in installed workflow
3 participants