You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
A user pushes a dataset with >100TB of data, with large individual files. They want to know a way to push commit-wise as the transfer stalls for hours when they push all at once.
My answer so far acknowledged that datalad does not support a syntax for this, but that commit-wise pushing would also not help. Instead, I recommended pushing individual files and seeing if it helps. I inguired about the remote the user is pushing to to get an idea of expected push durations.
TODO (not necessarily to be performed in this order)
Inform OP/Add reference to this issue at origin
Clarifying Qs asked or not needed
Nature of the issue is understood
Inform OP about resolution
The text was updated successfully, but these errors were encountered:
Origin: datalad/datalad#7432
A user pushes a dataset with >100TB of data, with large individual files. They want to know a way to push commit-wise as the transfer stalls for hours when they push all at once.
My answer so far acknowledged that datalad does not support a syntax for this, but that commit-wise pushing would also not help. Instead, I recommended pushing individual files and seeing if it helps. I inguired about the remote the user is pushing to to get an idea of expected push durations.
TODO (not necessarily to be performed in this order)
The text was updated successfully, but these errors were encountered: