Perplexity change percentage (from 1/vt=1 to higher)

of various segments of tokens in 16k-token samples

Vv 0%

-10%

-20%

& -30%

0- 2048

2048 - 4096

4096 - 6144

40%

6144 - 8192

8192 - 10240

10240 - 12288

12288 - 14336

& 50%

14336 - 16384

ul

12

13

14

15

Wt |
