You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
hannes-ucsc opened this issue
Jan 28, 2025
· 0 comments
Assignees
Labels
enh[type] New feature or requestepic[type] Issue consists of multiple smaller issuesmirror[subject] Code and infrastructure for mirroring data filesorange[process] Done by the Azul team
We would like the ability for Azul to manage a mirror in AWS of most/all of the data file in a source that it indexes. A source is a TDR snapshot, for example. When a client requests a file from the /repository/files endpoint, Azul should respond with a signed URL of the mirrored file, if it exists. Manifests, especially the curl manifest should also use the mirror.
The mirroring should be done for all sources in a catalog.
Currently, the most pressing use case is mirroring HCA in AWS.
enh[type] New feature or requestepic[type] Issue consists of multiple smaller issuesmirror[subject] Code and infrastructure for mirroring data filesorange[process] Done by the Azul team
We would like the ability for Azul to manage a mirror in AWS of most/all of the data file in a source that it indexes. A source is a TDR snapshot, for example. When a client requests a file from the
/repository/files
endpoint, Azul should respond with a signed URL of the mirrored file, if it exists. Manifests, especially thecurl
manifest should also use the mirror.The mirroring should be done for all sources in a catalog.
Currently, the most pressing use case is mirroring HCA in AWS.
Design: https://docs.google.com/document/d/197_hBqv9f3RP9Crr6ISI3G0JjEECDVyrIlKICpruL1A/edit?tab=t.0
The text was updated successfully, but these errors were encountered: