Category: tutorials

News
Review Microsoft's VALL-E 2 (Achieving Human Parity in Zero-shot TTS)
Tutorials

๋งˆ์ดํฌ๋กœ์†Œํ”„ํŠธ์˜ VALL-E 2 ๊ฒ€ํ†  (Zero-shot TTS์—์„œ ์ธ๊ฐ„ ์ˆ˜์ค€ ๋‹ฌ์„ฑ)

Zero-shot TTS๋Š” ๋งŽ์€ ์‚ฌ๋žŒ๋“ค์ด ์—ฌ์ „ํžˆ ๋ช‡ ๋…„ ๋จผ ๊ฒƒ์ด๋ผ๊ณ  ์ƒ๊ฐํ–ˆ๋˜ ์„ ์„ ๋„˜์—ˆ์Šต๋‹ˆ๋‹ค. ๋งˆ์ดํฌ๋กœ์†Œํ”„ํŠธ์˜ VALL-E 2๋Š” ๊ฒฌ๊ณ ์„ฑ, ์ž์—ฐ์Šค๋Ÿฌ์›€, ํ™”์ž ์œ ์‚ฌ์„ฑ ์ธก๋ฉด์—์„œ LibriSpeech์™€ VCTK ๋ชจ๋‘์—์„œ ์ธ๊ฐ„ ์ˆ˜์ค€์— ๋„๋‹ฌํ•œ ์ฒซ ๋ฒˆ์งธ ์‹ ๊ฒฝ๋ง ์ฝ”๋ฑ ์–ธ์–ด ๋ชจ๋ธ์ž…๋‹ˆ๋‹ค.

5์›” 7, 2025ยท 1 min read
Review DiTAR: Diffusion Transformer Autoregressive Modeling for Speech Generation ~ Seed-TTS
Tutorials

DiTAR ๊ฒ€ํ† : ์Œ์„ฑ ์ƒ์„ฑ์„ ์œ„ํ•œ Diffusion Transformer ์ž๊ธฐ ํšŒ๊ท€ ๋ชจ๋ธ๋ง ~ Seed-TTS

Seed-TTS ํŒ€์ด DiTAR๋กœ ๋Œ์•„์™”์œผ๋ฉฐ, ์ด๋Š” ํ˜„๋Œ€ ์Œ์„ฑ ์ƒ์„ฑ์˜ ๋” ์–ด์ƒ‰ํ•œ ํŠธ๋ ˆ์ด๋“œ์˜คํ”„ ์ค‘ ํ•˜๋‚˜์— ๋Œ€ํ•œ ๋ช…ํ™•ํ•œ ๋‹ต์ž…๋‹ˆ๋‹ค.

4์›” 19, 2025ยท 1 min read
Review ByteDance/Tiktok's Seed-TTS: A Family of High-Quality Versatile Speech Generation Models
Tutorials

ByteDance/Tiktok์˜ Seed-TTS ๊ฒ€ํ† : ๊ณ ํ’ˆ์งˆ ๋‹ค๋ชฉ์  ์Œ์„ฑ ์ƒ์„ฑ ๋ชจ๋ธ ์ œํ’ˆ๊ตฐ

ByteDance์˜ Seed-TTS๋Š” TTS๊ฐ€ ์ปดํฌ๋„ŒํŠธ์—์„œ ์ง„์ •ํ•œ ๊ธฐ์ดˆ ๋ชจ๋ธ๋กœ ์ง„ํ™”ํ•˜๊ณ  ์žˆ๋‹ค๋Š” ๊ฐ€์žฅ ๊ฐ•๋ ฅํ•œ ์‹ ํ˜ธ ์ค‘ ํ•˜๋‚˜์ž…๋‹ˆ๋‹ค.

4์›” 11, 2025ยท 1 min read
From OpenAI Whisper to Your In-House ASR Service: Recognizing Name Entities & Domain-Specific Terms
Tutorials

OpenAI Whisper์—์„œ ์ž์ฒด ASR ์„œ๋น„์Šค๋กœ: ์ด๋ฆ„ ์—”ํ‹ฐํ‹ฐ ๋ฐ ๋„๋ฉ”์ธ๋ณ„ ์šฉ์–ด ์ธ์‹

Whisper๋Š” ์ฆ‰์‹œ ์ธ์ƒ์ ์ด์ง€๋งŒ, ์‹ค์ œ๋กœ ํ”„๋กœ๋•์…˜์— ๋ฐฐํฌํ•œ ์‚ฌ๋žŒ์ด๋ผ๋ฉด ๋ˆ„๊ตฌ๋‚˜ ๊ณ ํ†ต์„ ์•Œ๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค: ๊ณ ์œ ๋ช…์‚ฌ, ์ œํ’ˆ ์ด๋ฆ„, ์˜๋ฃŒ ์šฉ์–ด, ๋ฒ•๋ฅ  ์šฉ์–ด, ๊ทธ๋ฆฌ๊ณ  ๋„๋ฉ”์ธ ์–ดํœ˜์˜ ์ „์ฒด ๊ธด ๊ผฌ๋ฆฌ๋ฅผ ์ž˜๋ชป ์ฒ˜๋ฆฌํ•ฉ๋‹ˆ๋‹ค

12์›” 20, 2024ยท 1 min read
Meta's Movie Gen vs. OpenAI's Sora: a Detailed Review
Tutorials

Meta์˜ Movie Gen vs. OpenAI์˜ Sora: ์ƒ์„ธ ๋ฆฌ๋ทฐ

Meta๋Š” ๋งˆ์นจ๋‚ด Sora์— ๋Œ€ํ•œ ์ž…์žฅ์„ ๋ณด์˜€๊ณ , Movie Gen์€ ๋‹จ์ˆœํ•œ ๋น„๋””์˜ค ์ƒ์„ฑ๊ธฐ ์ด์ƒ์ž…๋‹ˆ๋‹ค โ€” ๋‹ค์ค‘ aspect ratio๋กœ 1080p HD ๋น„๋””์˜ค๋ฅผ ์ƒ์„ฑํ•˜๊ณ  ๋™๊ธฐํ™”๋œ ์˜ค๋””์˜ค๋ฅผ ์ง€์›ํ•˜๋Š” foundation ๋ชจ๋ธ์˜ ์บ์ŠคํŠธ์ด๋ฉฐ, ์ •๋ฐ€ํ•ฉ๋‹ˆ๋‹ค

10์›” 25, 2024ยท 1 min read
Google Researcher's In-Depth Analysis on End-to-End Speech Recognition, Part 1: Overview & Modeling
Tutorials

Google ์—ฐ๊ตฌ์›์˜ End-to-End ์Œ์„ฑ ์ธ์‹์— ๋Œ€ํ•œ ์‹ฌ์ธต ๋ถ„์„, Part 1: ๊ฐœ์š” & ๋ชจ๋ธ๋ง

๋”ฅ๋Ÿฌ๋‹์˜ 10๋…„์€ ASR ๋‹จ์–ด ์˜ค๋ฅ˜์œจ์„ 50% ์ด์ƒ ์ƒ๋Œ€์ ์œผ๋กœ ๊ฐ์†Œ์‹œ์ผฐ๊ณ , ๊ทธ ๊ณผ์ •์—์„œ ๊ณ ์ „์ ์ธ HMM ํŒŒ์ดํ”„๋ผ์ธ์„ ์œ ๋ฌผ์ฒ˜๋Ÿผ ๋ณด์ด๊ฒŒ ๋งŒ๋“ค์—ˆ์Šต๋‹ˆ๋‹ค.

6์›” 7, 2024ยท 1 min read
Deduct OpenAI GPT-4o's Neural Network Architecture
Tutorials

OpenAI GPT-4o์˜ ์‹ ๊ฒฝ๋ง ์•„ํ‚คํ…์ฒ˜ ์ถ”๋ก ํ•˜๊ธฐ

OpenAI๋Š” GPT-4o์— ๋Œ€ํ•œ ๋…ผ๋ฌธ์„ ๋ฐœํ‘œํ•˜์ง€ ์•Š์•˜์œผ๋ฏ€๋กœ, ์ด ์˜์ƒ์€ ๋‹ค์Œ ์ตœ์„ ์˜ ๋ฐฉ๋ฒ•์„ ์ œ์‹œํ•ฉ๋‹ˆ๋‹ค: OpenAI๊ฐ€ ์‹ค์ œ๋กœ ์‹œ์—ฐํ•œ ๊ธฐ๋Šฅ์„ ๋ฐ”ํƒ•์œผ๋กœ ์‹ ๊ฒฝ๋ง ์•„ํ‚คํ…์ฒ˜๊ฐ€ ๊ฑฐ์˜ ํ™•์‹คํžˆ ์–ด๋–ค ๋ชจ์Šต์ธ์ง€๋ฅผ ์—ญ์—”์ง€๋‹ˆ์–ด๋งํ•ฉ๋‹ˆ๋‹ค

5์›” 17, 2024ยท 1 min read
Google's Universal Speech Model for 100+ languages beats OpenAI's Whisper Model
Tutorials

Google์˜ 100๊ฐœ ์ด์ƒ ์–ธ์–ด๋ฅผ ์ง€์›ํ•˜๋Š” Universal Speech Model์ด OpenAI์˜ Whisper Model์„ ๋Šฅ๊ฐ€ํ•ฉ๋‹ˆ๋‹ค

Google์˜ Universal Speech Model์€ ์กฐ์šฉํžˆ ๋†€๋ผ์šด ์„ฑ๊ณผ๋ฅผ ๋‹ฌ์„ฑํ–ˆ์Šต๋‹ˆ๋‹ค: ๋ ˆ์ด๋ธ”์ด ์ง€์ •๋œ ํ›ˆ๋ จ ๋ฐ์ดํ„ฐ์˜ ์•ฝ 1/7์„ ์‚ฌ์šฉํ•˜๋ฉด์„œ 100๊ฐœ ์ด์ƒ์˜ ์–ธ์–ด์—์„œ OpenAI์˜ Whisper์™€ ๋™๋“ฑํ•˜๊ฑฐ๋‚˜ ๋Šฅ๊ฐ€ํ•˜๋Š” ASR ์„ฑ๋Šฅ์„ ๋‹ฌ์„ฑํ–ˆ์Šต๋‹ˆ๋‹ค.

5์›” 6, 2024ยท 1 min read
Long Review: Apple's MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training
Tutorials

๊ธด ๋ฆฌ๋ทฐ: Apple์˜ MM1: ๋ฉ€ํ‹ฐ๋ชจ๋‹ฌ LLM ์‚ฌ์ „ ํ•™์Šต์˜ ๋ฐฉ๋ฒ•, ๋ถ„์„ ๋ฐ ์ธ์‚ฌ์ดํŠธ

Apple์€ ๋งŽ์ด ์ถœํŒํ•˜์ง€ ์•Š์œผ๋ฏ€๋กœ, MM1 ๋…ผ๋ฌธ์ด ๋ฉ€ํ‹ฐ๋ชจ๋‹ฌ LLM ์‚ฌ์ „ ํ•™์Šต์— ๋Œ€ํ•œ ์™„์ „ํ•œ ์ œ๊ฑฐ ์—ฐ๊ตฌ์™€ ํ•จ๊ป˜ ๋ฐœํ‘œ๋˜์—ˆ์„ ๋•Œ, MLLM์„ ๊ตฌ์ถ•ํ•˜๋Š” ๋ชจ๋“  ์‚ฌ๋žŒ์—๊ฒŒ ์˜ฌํ•ด ๋” ์œ ์šฉํ•œ ๋ฐ์ดํ„ฐ ๋ฆด๋ฆฌ์Šค ์ค‘ ํ•˜๋‚˜์˜€์Šต๋‹ˆ๋‹ค.

3์›” 31, 2024ยท 1 min read
A Quick Review of Apple's SOTA Multimodal LLM: MM1
Tutorials

Apple์˜ SOTA ๋ฉ€ํ‹ฐ๋ชจ๋‹ฌ LLM์˜ ๋น ๋ฅธ ๋ฆฌ๋ทฐ: MM1

MM1์˜ ์ „์ฒด ๋ถ„์„์— ์‹œ๊ฐ„์ด ์—†๋‹ค๋ฉด, ์ด ๋น ๋ฅธ ๋ฆฌ๋ทฐ๋Š” ๋ช‡ ๋ถ„ ์•ˆ์— ํ•ต์‹ฌ์„ ์ œ๊ณตํ•ฉ๋‹ˆ๋‹ค: Apple์ด ๊ตฌ์ถ•ํ•œ ๊ฒƒ, ์•„ํ‚คํ…์ฒ˜ ๋ฐ ๋ฐ์ดํ„ฐ์˜ ์ œ๊ฑฐ ์—ฐ๊ตฌ์—์„œ ๋ฐฐ์šด ๊ฒƒ, ๊ทธ๋ฆฌ๊ณ  ์–ด๋–ค ์„ค๊ณ„ ๊ฒฐ์ •์ด

3์›” 24, 2024ยท 1 min read
The Secret That Made Claude 3 Trump GPT-4
Tutorials

Claude 3์ด GPT-4๋ฅผ ๋Šฅ๊ฐ€ํ•˜๊ฒŒ ๋งŒ๋“  ๋น„๊ฒฐ

Claude 3 Opus๊ฐ€ MMLU, GPQA, GSM8K ๋ฐ ๋Œ€๋ถ€๋ถ„์˜ ๊ฒฝ๊ณ„ ํ‰๊ฐ€ ๋ฒค์น˜๋งˆํฌ์—์„œ GPT-4๋ฅผ ๋Šฅ๊ฐ€ํ–ˆ์„ ๋•Œ, ํฅ๋ฏธ๋กœ์šด ์งˆ๋ฌธ์€ Anthropic์ด ๋‹จ์ˆœํžˆ ๋” ํฌ๊ฒŒ ํ™•์žฅํ–ˆ๋Š”์ง€ ์—ฌ๋ถ€๊ฐ€ ์•„๋‹ˆ๋ผ ์–ด๋–ค ํ•™์Šต ์‹œ๊ฐ„ ๋น„๊ฒฐ์ด์—ˆ๋Š”์ง€์˜€์Šต๋‹ˆ๋‹ค.

3์›” 8, 2024ยท 1 min read
Generative AI Models Related to Sora: Normalizing Flows
Tutorials

Sora์™€ ๊ด€๋ จ๋œ ์ƒ์„ฑ AI ๋ชจ๋ธ: ์ •๊ทœํ™” ํ๋ฆ„

๋ชจ๋‘๊ฐ€ ํ™•์‚ฐ์— ๋Œ€ํ•ด ์ด์•ผ๊ธฐํ•˜๊ณ  ์žˆ์ง€๋งŒ, ์‹ค์ œ๋กœ Sora์™€ ํ˜„๋Œ€ ์ƒ์„ฑ ๋น„๋””์˜ค๋ฅผ ๋งŒ๋“  ๊ณ„ํ†ต์„ ์ดํ•ดํ•˜๋ ค๋ฉด, ์ •๊ทœํ™” ํ๋ฆ„์œผ๋กœ ์‹œ๊ฐ„์„ ๋ณด๋‚ด์•ผ ํ•ฉ๋‹ˆ๋‹ค โ€” ์ƒ์„ฑ ๋ชจ๋“œ์˜ ํด๋ž˜์Šค

3์›” 1, 2024ยท 1 min read
Variational Autoencoder (VAE) and Reparameterization Trick - Revisiting the Classic Generative Model
Tutorials

๋ณ€๋ถ„ ์ž๋™์ธ์ฝ”๋”(VAE) ๋ฐ ์žฌ๋งค๊ฐœ๋ณ€์ˆ˜ํ™” ํŠธ๋ฆญ - ๊ณ ์ „ ์ƒ์„ฑ ๋ชจ๋ธ ์žฌ๊ฒ€ํ† 

ํ™•์‚ฐ ๋ชจ๋ธ์ด ๋‚˜์˜ค๊ธฐ ์ „์—, ์ •๊ทœํ™” ํ๋ฆ„์ด ๋‚˜์˜ค๊ธฐ ์ „์—, ์ž ์žฌ ํ™•์‚ฐ ๋ชจ๋ธ์ด ์กฐ์šฉํžˆ VAE ์ธ์ฝ”๋”๋ฅผ ๋ชจ๋“  ์ง„์ง€ํ•œ ์ƒ์„ฑ ์Šคํƒ์— ๊ตฌ์ถ•ํ•˜๊ธฐ ์ „์— โ€” Kingma์™€ Welling์˜ 2013๋…„ ๋…ผ๋ฌธ์ด ๋ณ€๋ถ„ ์ž๋™์ธ์ฝ”๋”๋ฅผ ์†Œ๊ฐœ

2์›” 24, 2024ยท 1 min read
A Review of Microsoft+OpenAI, Google, Meta, and Nvidia's Open Source Large Speech Models for ASR
Tutorials

Microsoft+OpenAI, Google, Meta, ๋ฐ Nvidia์˜ ์˜คํ”ˆ ์†Œ์Šค ๋Œ€๊ทœ๋ชจ ์Œ์„ฑ ๋ชจ๋ธ ๊ฒ€ํ† (ASR์šฉ)

๋ชจ๋“  ์ฃผ์š” AI ์—ฐ๊ตฌ์†Œ๋Š” ์ด์ œ ASR์šฉ ์˜คํ”ˆ ์†Œ์Šค ๋Œ€๊ทœ๋ชจ ์Œ์„ฑ ๋ชจ๋ธ์„ ์ถœ์‹œํ–ˆ์œผ๋ฉฐ, ํ”„๋กœ๋•์…˜์šฉ์œผ๋กœ ์˜ฌ๋ฐ”๋ฅธ ๋ชจ๋ธ์„ ์„ ํƒํ•˜๋Š” ๊ฒƒ์ด ์‹ค์ œ ๊ฒฐ์ •์ด ๋˜์—ˆ์Šต๋‹ˆ๋‹ค.

2์›” 9, 2024ยท 1 min read
[Detailed Paper Reading] Zipformer: A faster and better encoder for automatic speech recognition
Tutorials

[์ƒ์„ธ ๋…ผ๋ฌธ ์ฝ๊ธฐ] Zipformer: ์ž๋™ ์Œ์„ฑ ์ธ์‹์„ ์œ„ํ•œ ๋” ๋น ๋ฅด๊ณ  ๋‚˜์€ ์ธ์ฝ”๋”

Conformer์€ ์ˆ˜๋…„ ๋™์•ˆ ๊ธฐ๋ณธ ASR ์ธ์ฝ”๋”์˜€์ง€๋งŒ, k2/icefall ํŒ€์˜ Zipformer์€ ๋” ๋น ๋ฅด๊ณ  ๊ฐ€๋ฒผ์šฐ๋ฉด์„œ๋„ LibriSpeech, Aishell-1, WenetSpeech์—์„œ ์กฐ์šฉํžˆ WER ์™•๊ด€์„ ์ฐจ์ง€ํ–ˆ์Šต๋‹ˆ๋‹ค.

2์›” 6, 2024ยท 1 min read
Tycho:a tookit for building high-ROI in-house speech-related services (ASR/TTS/Translation):Overview
Tutorials

Tycho: ๋†’์€ ROI ์ž์ฒด ์Œ์„ฑ ๊ด€๋ จ ์„œ๋น„์Šค(ASR/TTS/๋ฒˆ์—ญ) ๊ตฌ์ถ•์„ ์œ„ํ•œ ํˆดํ‚ท: ๊ฐœ์š”

์ž์ฒด ASR, TTS, ๋˜๋Š” ์Œ์„ฑ ๋ฒˆ์—ญ ์„œ๋น„์Šค๋ฅผ ์›ํ•˜๋Š” ๋Œ€๋ถ€๋ถ„์˜ ํŒ€์€ ๋™์ผํ•œ ๋ณต์žกํ•œ ์„ ํƒ์— ์ง๋ฉดํ•ฉ๋‹ˆ๋‹ค: ESPnet, NeMo, k2, HuggingFace์˜ ์กฐ๊ฐ๋“ค์„ ๋ถ™์ด๊ฑฐ๋‚˜, ๋ชจ๋“  ๊ฒƒ์„ ํด๋ผ์šฐ๋“œ API์— ๋„˜๊ธฐ๊ณ  ๋ถ„๋‹น ๋น„์šฉ์„ ์ง€๋ถˆ

1์›” 26, 2024ยท 1 min read
From OpenAI's Whisper Model to Your Own In-House ASR Service: Postprocessing and Language Modeling
Tutorials

OpenAI์˜ Whisper ๋ชจ๋ธ์—์„œ ์ž์‹ ์˜ ์ž์ฒด ASR ์„œ๋น„์Šค๋กœ: ํ›„์ฒ˜๋ฆฌ ๋ฐ ์–ธ์–ด ๋ชจ๋ธ๋ง

์›๋ณธ Whisper ์ถœ๋ ฅ์€ ๊ธฐ๋ณธ ์ƒํƒœ์—์„œ ์ธ์ƒ์ ์ด์ง€๋งŒ, ์‹ค์ œ ์‚ฌ์šฉ์ž์—๊ฒŒ ๋ฐฐํฌํ•œ ๋ชจ๋“  ์‚ฌ๋žŒ์€ ๋ฐ๋ชจ ํŠธ๋žœ์Šคํฌ๋ฆฝํŠธ์™€ ๋‹ค์šด์ŠคํŠธ๋ฆผ ์‹œ์Šคํ…œ์ด ์‹ค์ œ๋กœ ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ๋Š” ๊ฒƒ ์‚ฌ์ด์˜ ๊ฐ„๊ฒฉ์„ ์•Œ๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค.

1์›” 12, 2024ยท 1 min read
From OpenAI's Whisper Model to Your Own In-House ASR Service: Long Audio and Streaming (Part 3)
Tutorials

OpenAI์˜ Whisper ๋ชจ๋ธ์—์„œ ์ž์‹ ์˜ ์ž์ฒด ASR ์„œ๋น„์Šค๋กœ: ๊ธด ์˜ค๋””์˜ค ๋ฐ ์ŠคํŠธ๋ฆฌ๋ฐ (Part 3)

Whisper๋Š” 30์ดˆ ์ฒญํฌ๋กœ ํ•™์Šต๋˜์—ˆ์œผ๋ฉฐ, 2์‹œ๊ฐ„ ํŒŸ์บ์ŠคํŠธ๋ฅผ ์ž…๋ ฅํ•˜๊ฑฐ๋‚˜ ๋ผ์ด๋ธŒ ์บก์…˜ ํŒŒ์ดํ”„๋ผ์ธ์— ์—ฐ๊ฒฐํ•˜๋ ค๊ณ  ํ•  ๋•Œ ํ•œ๊ณ„๋ฅผ ๋“œ๋Ÿฌ๋ƒ…๋‹ˆ๋‹ค.

12์›” 15, 2023ยท 1 min read
From OpenAI's Whisper Model to Your Own In-House ASR Service: ROI (Return-on-Investment) (Part 2)
Tutorials

OpenAI์˜ Whisper ๋ชจ๋ธ์—์„œ ์ž์‹ ์˜ ์ž์ฒด ASR ์„œ๋น„์Šค๋กœ: ROI (ํˆฌ์ž ์ˆ˜์ต๋ฅ ) (Part 2)

ASR์˜ ๊ตฌ์ถ• ๋Œ€ ๊ตฌ๋งค ์งˆ๋ฌธ์€ ์ผ๋ฐ˜์ ์œผ๋กœ ์ •ํ™•๋„ ๋Œ€ ํŽธ์˜์„ฑ์œผ๋กœ ํ”„๋ ˆ์ž„ํ™”๋˜์ง€๋งŒ, ์‹ค์ œ ๊ฒฐ์ • ์š”์†Œ๋Š” ์ œํ’ˆ ์ˆ˜๋ช… ๋™์•ˆ์˜ ROI์ž…๋‹ˆ๋‹ค.

12์›” 2, 2023ยท 1 min read
From OpenAI's Whisper Model to Your Own In-House ASR Service: Overview (Part 1)
Tutorials

OpenAI์˜ Whisper ๋ชจ๋ธ์—์„œ ์ž์‹ ์˜ ์ž์ฒด ASR ์„œ๋น„์Šค๋กœ: ๊ฐœ์š” (Part 1)

OpenAI๊ฐ€ Whisper๋ฅผ ์˜คํ”ˆ์†Œ์Šค๋กœ ๊ณต๊ฐœํ–ˆ์„ ๋•Œ, ์ž์ฒด ASR ์„œ๋น„์Šค๊ฐ€ ์–ด๋–ป๊ฒŒ ๋ณด์ด๋Š”์ง€์— ๋Œ€ํ•œ ๊ธฐ์ค€์„ ์„ ์กฐ์šฉํžˆ ์žฌ์„ค์ •ํ–ˆ์Šต๋‹ˆ๋‹ค.

11์›” 3, 2023ยท 1 min read
Why word timestamps generated by OpenAI Whisper are not accurate? How to make them accurate again?
Tutorials

OpenAI Whisper๊ฐ€ ์ƒ์„ฑํ•œ ๋‹จ์–ด ํƒ€์ž„์Šคํƒํ”„๊ฐ€ ์ •ํ™•ํ•˜์ง€ ์•Š์€ ์ด์œ ๋Š”? ๋‹ค์‹œ ์ •ํ™•ํ•˜๊ฒŒ ๋งŒ๋“ค ์ˆ˜ ์žˆ์„๊นŒ?

Whisper์— ๋‹จ์–ด ํƒ€์ž„์Šคํƒํ”„๋ฅผ ์š”์ฒญํ•˜๋ฉด ์ˆซ์ž๊ฐ€ ๋ฐ˜ํ™˜๋ฉ๋‹ˆ๋‹ค โ€” ํ•˜์ง€๋งŒ ์‹ค์ œ ์˜ค๋””์˜ค์™€ ๋งž์ถฐ๋ณด๋ ค๊ณ  ์‹œ๋„ํ•œ ๊ฒฝํ—˜์ด ์žˆ๋‹ค๋ฉด, ๋…ธ๋ž˜๋ฐฉ, ์ž๋ง‰, ๋”๋น™์„ ์œ„ํ•ด ๋“œ๋ฆฌํ”„ํŠธ๊ฐ€ ๋ฐœ์ƒํ•˜๊ณ  ์ž˜๋ชป๋œ ๊ฒฝ๊ณ„๋กœ ์Šค๋ƒ…๋˜๋ฉฐ ๊ฐ€๋”์€

10์›” 20, 2023ยท 1 min read
Speech Generative AI: VoiceBox by Meta AI (also Flow Matching and Neural ODE)
Tutorials

์Œ์„ฑ ์ƒ์„ฑ AI: Meta AI์˜ VoiceBox(Flow Matching๊ณผ Neural ODE๋„)

์ˆ˜๋…„ ๋™์•ˆ ์Œ์„ฑ ์ƒ์„ฑ์€ ๊ทœ๋ชจ์™€ ์ผ๋ฐ˜์„ฑ ์ธก๋ฉด์—์„œ ํ…์ŠคํŠธ ๋ฐ ์ด๋ฏธ์ง€ ์ƒ์„ฑ์— ๋’ค๋–จ์–ด์กŒ์Šต๋‹ˆ๋‹ค โ€” ๋ชจ๋“  ์ž‘์—…์€ ์ž์ฒด ๋งž์ถคํ˜• ๋ชจ๋ธ์„ ์‚ฌ์šฉํ–ˆ์Šต๋‹ˆ๋‹ค.

9์›” 14, 2023ยท 1 min read
I-JEPA: Yannn LeCun's First 'World Model' for Computer Vision
Tutorials

I-JEPA: Yann LeCun์˜ ์ฒซ ๋ฒˆ์งธ '์„ธ๊ณ„ ๋ชจ๋ธ' ์ปดํ“จํ„ฐ ๋น„์ „์šฉ

Yann LeCun์€ ์ˆ˜๋…„ ๋™์•ˆ ์ƒ์„ฑํ˜• ์‚ฌ์ „ ํ›ˆ๋ จ์ด ์„ธ๊ณ„๋ฅผ ์ดํ•ดํ•˜๋Š” ๊ธฐ๊ณ„๋ฅผ ๋งŒ๋“ค๊ธฐ ์œ„ํ•œ ์ž˜๋ชป๋œ ๋ฒ ํŒ…์ด๋ผ๊ณ  ์ฃผ์žฅํ•ด์™”์Šต๋‹ˆ๋‹ค.

6์›” 17, 2023ยท 1 min read
LoRA: allow a high school student to train Large Language Model (GPT-3) with a gaming graphics card
Tutorials

LoRA: ๊ณ ๋“ฑํ•™์ƒ๋„ ๊ฒŒ์ด๋ฐ ๊ทธ๋ž˜ํ”ฝ ์นด๋“œ๋กœ ๋Œ€๊ทœ๋ชจ ์–ธ์–ด ๋ชจ๋ธ(GPT-3)์„ ํ›ˆ๋ จํ•  ์ˆ˜ ์žˆ๊ฒŒ ํ•˜๋‹ค

175B ํŒŒ๋ผ๋ฏธํ„ฐ GPT-3์˜ ์ „์ฒด ๋ฏธ์„ธ ์กฐ์ •์€ ๊ฑฐ์˜ ๋ชจ๋“  ์‚ฌ๋žŒ์—๊ฒŒ ํ˜„์‹ค์ ์ด์ง€ ์•Š์Šต๋‹ˆ๋‹ค โ€” ์ €์žฅ ๊ณต๊ฐ„๋งŒ์œผ๋กœ๋„ ๋ถˆ๊ฐ€๋Šฅํ•˜๋ฉฐ, GPU๋Š” ๋งํ•  ๊ฒƒ๋„ ์—†์Šต๋‹ˆ๋‹ค.

6์›” 3, 2023ยท 1 min read
A Review of SpeechT5: Introducing Google's T5 into Speech (ASR, TTS, SID, ...) Tasks
Tutorials

SpeechT5 ๋ฆฌ๋ทฐ: ์Œ์„ฑ(ASR, TTS, SID, ...) ์ž‘์—…์— Google์˜ T5 ๋„์ž…ํ•˜๊ธฐ

T5๋Š” ๋‹จ์ผ ์ธ์ฝ”๋”-๋””์ฝ”๋” ์‚ฌ์ „ ํ›ˆ๋ จ ๋ฐฉ์‹ ์•„๋ž˜์—์„œ ํ…์ŠคํŠธ-ํ…์ŠคํŠธ ์ž‘์—…์„ ํ†ตํ•ฉํ–ˆ์œผ๋ฉฐ NLP์˜ ํ•ต์‹ฌ ๋„๊ตฌ๊ฐ€ ๋˜์—ˆ์Šต๋‹ˆ๋‹ค.

5์›” 20, 2023ยท 1 min read
A Review of Deepmind's WaveNet for TTS/Audio Synthesis (Does it look like GPT to you?)
Tutorials

Deepmind์˜ WaveNet TTS/์˜ค๋””์˜ค ํ•ฉ์„ฑ ๋ฆฌ๋ทฐ (๋‹น์‹ ์—๊ฒŒ GPT์ฒ˜๋Ÿผ ๋ณด์ด๋‚˜์š”?)

Tacotron ์ด์ „์—, VALL-E ์ด์ „์—, ์‹ ๊ฒฝ ์ฝ”๋ฑ์ด ์˜ค๋””์˜ค๋ฅผ ํ† ํฐ์œผ๋กœ ๋ณ€ํ™˜ํ•˜๊ธฐ ์ด์ „์—, DeepMind์˜ WaveNet์€ ์‹ ๊ฒฝ๋ง์ด ์›๋ณธ ์˜ค๋””์˜ค ํŒŒํ˜•์„ ์ƒ˜ํ”Œ ๋‹จ์œ„๋กœ ์ƒ์„ฑํ•  ์ˆ˜ ์žˆ์Œ์„ ๋ณด์—ฌ์ค€ ๋…ผ๋ฌธ์ด์—ˆ๊ณ  ๋ชจ๋“  ๋งค๊ฐœ๋ณ€์ˆ˜์‹

5์›” 6, 2023ยท 1 min read
Review of HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesis
Tutorials

HiFi-GAN ๋ฆฌ๋ทฐ: ํšจ์œจ์ ์ด๊ณ  ๊ณ ์ถฉ์‹ค๋„ ์Œ์„ฑ ํ•ฉ์„ฑ์„ ์œ„ํ•œ ์ƒ์„ฑ ์ ๋Œ€ ๋„คํŠธ์›Œํฌ

์˜ค๋žซ๋™์•ˆ ์‹ ๊ฒฝ ๋ณด์ฝ”๋”๋Š” ์„ ํƒ์„ ๊ฐ•์š”ํ–ˆ์Šต๋‹ˆ๋‹ค: WaveNet๊ณผ ๊ฐ™์€ ์ž๋™ํšŒ๊ท€ ๋ชจ๋ธ์€ ์•„๋ฆ„๋‹ค์šด ์˜ค๋””์˜ค๋ฅผ ์ œ๊ณตํ–ˆ์ง€๋งŒ ๊ณ ํ†ต์Šค๋Ÿฝ๊ฒŒ ๋А๋ ธ๊ณ , GAN ๊ธฐ๋ฐ˜ ํŒŒํ˜• ์ƒ์„ฑ๊ธฐ๋Š” ๋น ๋ฅด์ง€๋งŒ ๋ˆˆ์— ๋„๊ฒŒ ๋‚ฎ์€ ํ’ˆ์งˆ์ด์—ˆ์Šต๋‹ˆ๋‹ค.

4์›” 22, 2023ยท 1 min read
In-depth Review of Google's SoundStream: An End-to-End Neural Audio Codec
Tutorials

Google์˜ SoundStream ์‹ฌ์ธต ๋ฆฌ๋ทฐ: ์—”๋“œ-ํˆฌ-์—”๋“œ ์‹ ๊ฒฝ ์˜ค๋””์˜ค ์ฝ”๋ฑ

์‹ ๊ฒฝ ์ฝ”๋ฑ์€ ์กฐ์šฉํžˆ ํ˜„๋Œ€ ์ƒ์„ฑ ์˜ค๋””์˜ค์˜ ๊ธฐ์ดˆ ๊ณ„์ธต์ด ๋˜์—ˆ๊ณ , SoundStream์€ ์‹œ์ž‘์„ ์‹ ํ˜ธํ•œ ๋…ผ๋ฌธ ์ค‘ ํ•˜๋‚˜์ž…๋‹ˆ๋‹ค.

4์›” 8, 2023ยท 1 min read
Disclosing OpenAI GPT-4's vision+text model, data, and cost to train (speculated)
Tutorials

OpenAI GPT-4์˜ ๋น„์ „+ํ…์ŠคํŠธ ๋ชจ๋ธ, ๋ฐ์ดํ„ฐ ๋ฐ ํ•™์Šต ๋น„์šฉ ๊ณต๊ฐœ (์ถ”์ธก)

OpenAI๋Š” GPT-4์˜ ์•„ํ‚คํ…์ฒ˜, ํŒŒ๋ผ๋ฏธํ„ฐ ์ˆ˜, ํ•™์Šต ๋ฐ์ดํ„ฐ ๋˜๋Š” ์ปดํ“จํŒ… ์˜ˆ์‚ฐ์„ ๊ณต๊ฐœํ•˜์ง€ ์•Š๊ธฐ๋กœ ์•…๋ช…๋†’์œผ๋ฉฐ, ์ด๋Š” ๊ธฐ์ˆ  ๋ณด๊ณ ์„œ๋ฅผ ML ์ปค๋ฎค๋‹ˆํ‹ฐ๋ฅผ ์œ„ํ•œ ๋กœ๋ฅด์ƒคํ ํ…Œ์ŠคํŠธ๋กœ ๋ฐ”๊พธ์—ˆ์Šต๋‹ˆ๋‹ค.

4์›” 1, 2023ยท 1 min read