20 Total Retrieved Documents

(~4K tokens, randomly ordered)

15

70

o 65

< 60

eo

55

lst

5th

1Oth

L5th

20th

Position of Document with the Answer

=@— claude-1.3

=@®= gpt-3.5-turbo-16k-0613

=—®= claude-1.3-100k

=O mpt-30b-instruct

=@®— gpt-3.5-turbo-0613

=@®= longchat-13b-16k
