Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

wrong ACC/AP in SD-v1 #17

Open
baiqingookii opened this issue Oct 16, 2023 · 1 comment
Open

wrong ACC/AP in SD-v1 #17

baiqingookii opened this issue Oct 16, 2023 · 1 comment

Comments

@baiqingookii
Copy link

I used lsun_pndm.pth and test on lsun/lsun/sdv1,but got
lsun_lsun_sdv1:
ACC: 1.00000
AP: 1.00000
R_ACC: 1.00000
F_ACC: 1.00000
,and I train the model used the dataset and got the same result.but the paper says the result is 89.4/99.9.Does anyone have the same result with me?

@LoreImbo
Copy link

LoreImbo commented Nov 27, 2023

I used lsun_pndm.pth and test on lsun/lsun/sdv1,but got lsun_lsun_sdv1: ACC: 1.00000 AP: 1.00000 R_ACC: 1.00000 F_ACC: 1.00000 ,and I train the model used the dataset and got the same result.but the paper says the result is 89.4/99.9.Does anyone have the same result with me?

I had the same results, not only with the ckpt lsun_pndm.pth, but also with lsun_adm.pth and lsun_iddpm.pth.
I think it is a problem with the entire dataset or maybe an incorrect transcription of the results on the paper.
I attach a screen with the results.
Ckpt ADM
Screenshot 2023-11-28 alle 15 01 45
Ckpt PNDM
Screenshot 2023-11-28 alle 15 02 49
Ckpt IDDPM
Screenshot 2023-11-28 alle 15 03 19

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants