Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Compute and Transfer Example Flows #1

Open
wants to merge 7 commits into
base: main
Choose a base branch
from

Conversation

MaxTueckeGlobus
Copy link

@MaxTueckeGlobus MaxTueckeGlobus commented Feb 28, 2025

Created two example Compute and Transfer flows and a script to register the Compute function both examples invoke.

  • Example flow 1 takes a user-provided list of source files that already exists in the co-located GCS collection, creates a tarfile from it, and transfers the tarfile to a user provided destination collection.
  • Example flow 2 takes in a user-provided list source files that exists on a user provided source collection, creates a tarfile from it, and transfers the tarfile to a user provided destination collection.

@MaxTueckeGlobus MaxTueckeGlobus marked this pull request as ready for review February 28, 2025 21:52
Copy link
Member

@kurtmckee kurtmckee left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm leaving initial feedback about the names and descriptions for a number of items. I'll come back to review the Python/JSON code after you've had a chance to review/respond. 👍


and save the Compute function's UUID.

**Important**: Use the same Python version for registration as the one running on your Globus Compute Endpoint.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is there an easy way to verify the remote python version via the CLI? If so, might be helpful to show a CLI snippet here as an example?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

After thinking about it for a bit, adding this would mean diving into the globus-compute-endpoint CLI which is then encroaching on the territory of the linked tutorial for endpoint setup in 'Prerequisites'. Unless you have strong feelings about this, I'm inclined to leave it as is.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants