Skip to content

Commit 44ef3f0

Browse files
jqdmRLaxDev
authored andcommitted
Normalise target with the updated PopArt statistics in PopArt example.
Fixes #111 PiperOrigin-RevId: 491870340
1 parent d6bdb68 commit 44ef3f0

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/pop_art.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -150,7 +150,7 @@ def _loss(self, params, pop_art_state, obs_tm1, a_tm1, r_t, discount_t,
150150
popped_params = hk.data_structures.to_immutable_dict(mutable_params)
151151

152152
# Normalize target with updated PopArt statistics.
153-
norm_target_tm1 = rlax.normalize(pop_art_state, target_tm1, indices)
153+
norm_target_tm1 = rlax.normalize(new_pop_art_state, target_tm1, indices)
154154

155155
# Calculate parameter update with normalized target and popped parameters.
156156
norm_q_t = self._network.apply(popped_params, obs_t)

0 commit comments

Comments
 (0)