(a) Intra-Chunk Attention

(b) Inter-Chunk Attention

(c) Successive-Chunk Attention

of} Fy tT ET Ty

of} | PET ET

1 0

|i ty yyy

|i ty yy

fo] PE ET ET Ty

fof | TT TT TT TY

2 1 0

|i ty yy

2fifoy | | ty ty | |

2frfo} |} tty ty

o | 2 {il {ie

pt i tt |

|| | | fo

| tt

of | | | tt

| | | io

| ft

tfo} | | Ty

tfo} | | Tt

|| | | jz 1 0

| |

fo; | Tt |

fo] | Tt

P| ft | fe 2 of |

|

|] |

of | |

7 {6 [5 |4 |4

of | |

tfo} | |

|] ty} tt ft oo

7 {6 [5 |4

tjo} | |

|| | ttt tt fa 1 0

2 {i jo] |

7 {6 |5 | 4

2 fifo} |

pt} | | tt js 22 0

2 | Jo |

7 |6 [5 Ja]?

2 ato
