Tag: globalattention

News
[Olewave's Review] Branchformer: Parallel MLP-Attention Architectures, and E-Branchformer
Tutorials

[Olewave์˜ ๋ฆฌ๋ทฐ] Branchformer: Parallel MLP-Attention Architectures, and E-Branchformer

Conformer๋Š” ์ˆ˜๋…„๊ฐ„ ์ตœ๊ณ ์˜ ASR ์ธ์ฝ”๋”์˜€์ง€๋งŒ, Branchformer์™€ ๊ทธ ํ›„์†์ž‘์ธ E-Branchformer๋Š” ์ˆœ์ฐจ์  conv-plus-attention์ด ์œ ์ผํ•œ ๊ฒฝ๋กœ๊ฐ€ ์•„๋‹ˆ๋ผ๋Š” ์„ค๋“๋ ฅ ์žˆ๋Š” ์ฃผ์žฅ์„ ์ œ์‹œํ•ฉ๋‹ˆ๋‹ค.

11์›” 19, 2022ยท 1 min read