75 Key-Value Pairs (~4K tokens)

140 Key-Value Pairs (~8K tokens)

300 Sais Pairs (~16K tokens)

100

———*;*"""""*

100

oa ie

100

4

@

<=

= oe

ay

=

i)

90

~

_~o-=-=

-=%8

90

~= 392

90

~

wooo

=-=g

CP

80

e

80

80

~~ 97 yA

70

70

70

60

60

60

50

50

50

\ 1

40

40

4

40

lst

25th

50th

75th

1st

35th

70th

105th

140th

lst

50th 100th 150th 200th 250th 300th

Position of Key to Retrieve

Position of Key to Retrieve

Position of Key to Retrieve

=@— claude-1.3

=@® claude-1.3-100k

=@®— gpt-3.5-turbo-0613

=@®= gpt-3.5-turbo-16k-0613

=O mpt-30b-instruct

=@®= longchat-13b-16k
