Contact us

Tag: switchtransformer

News
Is Nathan Chen's 4 Flip scored by Mixture-of-Experts? Part 1: Switch Transformers: sparse MoE models
Tutorials

Nathan Chen์˜ 4ํšŒ์ „ ํ”Œ๋ฆฝ์ด Mixture-of-Experts๋กœ ์ฑ„์ ๋ฉ๋‹ˆ๊นŒ? Part 1: Switch Transformers: ํฌ์†Œ MoE ๋ชจ๋ธ

Nathan Chen์˜ 4ํšŒ์ „ ์ ์ˆ˜์— ๋Œ€ํ•œ ์šฐ์Šค๊ฐฏ์†Œ๋ฆฌ๋กœ ํ‘œํ˜„๋˜๋Š” ์ด ํ† ๋ก ์€ Switch Transformer๋ฅผ ์‚ดํŽด๋ด…๋‹ˆ๋‹ค. Google์˜ Mixture-of-Experts ํ™•์žฅ์— ๋Œ€ํ•œ ๊น”๋”ํ•˜๊ณ  ๊ณผ๊ฐํ•˜๊ฒŒ ๋‹จ์ˆœํ™”๋œ ํ•ด์„์ž…๋‹ˆ๋‹ค.

2์›” 12, 2022ยท 1 min read