Issue with DSG File Path in Clio-Online Evaluation Code

[zachzhuu]

Hi Team,

Thank you for sharing your impressive work on real-time 3D scene graph building. However, I encountered an issue while running the Clio-online evaluation code, specifically with the DSG file path. Here's the command I used as your instructions:

python clio_eval/experiments/evaluate_ablations.py --config clio_eval/experiments/configs/ablations/realtime_clustering.yaml

Upon reviewing the source code in evaluate_ablations.py, I found the following snippet:

log_folder = "{}/{}/trial_{}/{}".format(
    ablations.env["log_path"], dataset, trial, label)
dsg_file = os.path.join(
    log_folder, os.path.join("backend", "dsg.json"))

This suggests that the evaluation requires a DSG file located under the path <log_path>/office/trial_0/backend/dsg.json. However, after running Clio-online, I only found the DSG file at src/hydra/output/realsense/backend/dsg.json, which has a different parent path than expected.

Could you kindly clarify the following?

• What does the log_path in realtime_clustering.yaml refer to?
• Which DSG file should be used for evaluating the real-time Clio model?

Thank you for your help, and I look forward to your response.

Best,
Yiming