About get_embeds function

[jihoojung0106]

in get_embeds function, default pad_id is set to -1.
but, in CoarseTransformerWrapper, I remember that the padding was set to 0.
in that case, shouldn't the get_embeds function in the CoarseTransformer foward function gets the argument pad_id=0??

[lucidrains]

@jihoojung0106 where do you see it being set to 0? i see -1 here https://github.com/lucidrains/audiolm-pytorch/blob/main/audiolm_pytorch/audiolm_pytorch.py#L1530