Contact us

Tag: llm

News
LoRA: allow a high school student to train Large Language Model (GPT-3) with a gaming graphics card
Tutorials

LoRA: ๊ณ ๋“ฑํ•™์ƒ๋„ ๊ฒŒ์ด๋ฐ ๊ทธ๋ž˜ํ”ฝ ์นด๋“œ๋กœ ๋Œ€๊ทœ๋ชจ ์–ธ์–ด ๋ชจ๋ธ(GPT-3)์„ ํ›ˆ๋ จํ•  ์ˆ˜ ์žˆ๊ฒŒ ํ•˜๋‹ค

175B ํŒŒ๋ผ๋ฏธํ„ฐ GPT-3์˜ ์ „์ฒด ๋ฏธ์„ธ ์กฐ์ •์€ ๊ฑฐ์˜ ๋ชจ๋“  ์‚ฌ๋žŒ์—๊ฒŒ ํ˜„์‹ค์ ์ด์ง€ ์•Š์Šต๋‹ˆ๋‹ค โ€” ์ €์žฅ ๊ณต๊ฐ„๋งŒ์œผ๋กœ๋„ ๋ถˆ๊ฐ€๋Šฅํ•˜๋ฉฐ, GPU๋Š” ๋งํ•  ๊ฒƒ๋„ ์—†์Šต๋‹ˆ๋‹ค.

6์›” 3, 2023ยท 1 min read