Pressure Testing Mistral-7B-Instruct-v0.2 192k Context

Pressure Testing Chunk-Mistral 192k Context

(“Needle In A HayStack")

("Needle In A HayStack")

6.25 4

6.25 4

- 10

12.5 4

12.54

18.75 4

18.75 4

25.0 +

25.0 4

+ 0.8

31.25 4

31.25 4

37.5 4

37.5 4

43.75 4

43.75 4

> 0.6

50.0 +

50.0 4

56.25 =

56.25 4

62.5 4

62.5 4

> 0.4

68.75 4

68.75 4

75.0 4

75.0 4

81.25 4

81.25 4

0.2

87.5 4

87.5 4

93.75 4

93.75 4

100.0 4

100.0 4

0.0

104k 112k 120k 128k 136k 144k 152k 160k 168k 176k 184k 192k

104k 112k 120k 128k 136k 144k 152k 160k 168k 176k 184k 192k

Token Limit

Token Limit
