Skip to content

Commit f2a1dcf

Browse files
authored
updated test accuracy
1 parent f413a81 commit f2a1dcf

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

README.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -55,9 +55,9 @@ python train.py --dataset rocstories --desc rocstories --submit --analysis --dat
5555
#### First experiments on the ROCStories test set
5656
Finetuning the PyTorch model for 3 Epochs on ROCStories takes 10 minutes to run on a single NVidia K-80.
5757

58-
The test accuracy of this PyTorch version is 83.43% (with the default TensorFlow hyper-parameters not finetuned on the PyTorch model to take into account the differences between PyTorch and TensorFlow internals).
58+
The test accuracy of this PyTorch version is 85.25%, while the authors reports a median accuracy with the TensorFlow code of 85.8%.
5959

60-
The authors reports a median accuracy with the TensorFlow code of 85.8%.
60+
The reason for this small discrepency is likely that the authors implementations uses 8 GPU and can thus accomodate a batch of 64 samples while the present implementation is single GPU and is thus limited to 16 instance on a K80 for memory reasons.
6161

6262
The paper reports a best single run accuracy of 86.5%.
6363

0 commit comments

Comments
 (0)