Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dimension mismatch error when changing img_history_size in configs/base.yaml #65

Open
Wyatt2021 opened this issue Jan 10, 2025 · 1 comment

Comments

@Wyatt2021
Copy link

When modifying the img_history_size parameter in the configs/base.yaml file, the model encounters a dimension mismatch error during the forward pass. Specifically, the error occurs when adding tensors img_c and self.img_cond_pos_embed.
Error Message:
The error encountered is as follows:

File "/path/to/RoboticsDiffusionTransformer/models/rdt/model.py", line 153, in forward
img_c = img_c + self.img_cond_pos_embed
RuntimeError: The size of tensor a (21870) must match the size of tensor b (4374) at non-singleton dimension 1
The shapes of the tensors involved:

img_c: torch.Size([2, 21870, 2048])
self.img_cond_pos_embed: torch.Size([1, 4374, 2048])

@soumajm
Copy link

soumajm commented Jan 28, 2025

Did you change the number of cameras in configs/base.yaml ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants