Questions about DynamicNTK

[wutong4012]

yarn/scaled_rope/modeling_llama_yarn.py

Line 214 in ff9321f

(self.scaling_factor * seq_len / self.max_position_embeddings) - (self.scaling_factor - 1)

Please tell me here, if I want to expand from 2K to 16K, then the factor multiplied by the base here is
$(8 * 16K / 2K) - (8 - 1) = 57$,
Is this multiple reasonable? Are there some problems here?
Please correct me if I'm wrong.

@bloc97