The comparison between RoPE, Dynamic-PI and Dynamic-YaRN on Llama-2 7b

—— ROPE

5.50

— Dynamic-PI

— DynamicYaRN

5.25

5.00

rs 4.75

4.50

4.25

4.00

1000

2000

3000

4000

5000

6000

7000

8000

Context length (# of tokens)
