Tag: tts

News
Review Microsoft's VALL-E 2 (Achieving Human Parity in Zero-shot TTS)
Tutorials

๋งˆ์ดํฌ๋กœ์†Œํ”„ํŠธ์˜ VALL-E 2 ๊ฒ€ํ†  (Zero-shot TTS์—์„œ ์ธ๊ฐ„ ์ˆ˜์ค€ ๋‹ฌ์„ฑ)

Zero-shot TTS๋Š” ๋งŽ์€ ์‚ฌ๋žŒ๋“ค์ด ์—ฌ์ „ํžˆ ๋ช‡ ๋…„ ๋จผ ๊ฒƒ์ด๋ผ๊ณ  ์ƒ๊ฐํ–ˆ๋˜ ์„ ์„ ๋„˜์—ˆ์Šต๋‹ˆ๋‹ค. ๋งˆ์ดํฌ๋กœ์†Œํ”„ํŠธ์˜ VALL-E 2๋Š” ๊ฒฌ๊ณ ์„ฑ, ์ž์—ฐ์Šค๋Ÿฌ์›€, ํ™”์ž ์œ ์‚ฌ์„ฑ ์ธก๋ฉด์—์„œ LibriSpeech์™€ VCTK ๋ชจ๋‘์—์„œ ์ธ๊ฐ„ ์ˆ˜์ค€์— ๋„๋‹ฌํ•œ ์ฒซ ๋ฒˆ์งธ ์‹ ๊ฒฝ๋ง ์ฝ”๋ฑ ์–ธ์–ด ๋ชจ๋ธ์ž…๋‹ˆ๋‹ค.

5์›” 7, 2025ยท 1 min read
Review DiTAR: Diffusion Transformer Autoregressive Modeling for Speech Generation ~ Seed-TTS
Tutorials

DiTAR ๊ฒ€ํ† : ์Œ์„ฑ ์ƒ์„ฑ์„ ์œ„ํ•œ Diffusion Transformer ์ž๊ธฐ ํšŒ๊ท€ ๋ชจ๋ธ๋ง ~ Seed-TTS

Seed-TTS ํŒ€์ด DiTAR๋กœ ๋Œ์•„์™”์œผ๋ฉฐ, ์ด๋Š” ํ˜„๋Œ€ ์Œ์„ฑ ์ƒ์„ฑ์˜ ๋” ์–ด์ƒ‰ํ•œ ํŠธ๋ ˆ์ด๋“œ์˜คํ”„ ์ค‘ ํ•˜๋‚˜์— ๋Œ€ํ•œ ๋ช…ํ™•ํ•œ ๋‹ต์ž…๋‹ˆ๋‹ค.

4์›” 19, 2025ยท 1 min read
Review ByteDance/Tiktok's Seed-TTS: A Family of High-Quality Versatile Speech Generation Models
Tutorials

ByteDance/Tiktok์˜ Seed-TTS ๊ฒ€ํ† : ๊ณ ํ’ˆ์งˆ ๋‹ค๋ชฉ์  ์Œ์„ฑ ์ƒ์„ฑ ๋ชจ๋ธ ์ œํ’ˆ๊ตฐ

ByteDance์˜ Seed-TTS๋Š” TTS๊ฐ€ ์ปดํฌ๋„ŒํŠธ์—์„œ ์ง„์ •ํ•œ ๊ธฐ์ดˆ ๋ชจ๋ธ๋กœ ์ง„ํ™”ํ•˜๊ณ  ์žˆ๋‹ค๋Š” ๊ฐ€์žฅ ๊ฐ•๋ ฅํ•œ ์‹ ํ˜ธ ์ค‘ ํ•˜๋‚˜์ž…๋‹ˆ๋‹ค.

4์›” 11, 2025ยท 1 min read
What Makes Olewave's Speech Data Cleaning Pipeline Effective and Unique
Research

Olewave์˜ ์Œ์„ฑ ๋ฐ์ดํ„ฐ ์ฒญ์†Œ ํŒŒ์ดํ”„๋ผ์ธ์„ ํšจ๊ณผ์ ์ด๊ณ  ๋…ํŠนํ•˜๊ฒŒ ๋งŒ๋“œ๋Š” ๊ฒƒ์€ ๋ฌด์—‡์ธ๊ฐ€

Olewave์˜ Olign ํŒŒ์ดํ”„๋ผ์ธ์ด ์›๋ณธ ์˜ค๋””์˜ค๋ฅผ ํ”„๋กœ๋•์…˜ ์ค€๋น„ ์™„๋ฃŒ๋œ ASR/TTS ํ›ˆ๋ จ ๋ฐ์ดํ„ฐ๋กœ ๋ณ€ํ™˜ํ•˜๋Š” ๋ฐฉ๋ฒ• โ€” ๊ฒ€์ฆ๋œ ํŠธ๋žœ์Šคํฌ๋ฆฝํŠธ, ๋‹จ์–ด ์ˆ˜์ค€ ํƒ€์ž„์Šคํƒํ”„, ๋ฐ ์‹ ๋ขฐ๋„ ์ ์ˆ˜, ์ธ๊ฐ„ ๋ ˆ์ด๋ธ”๋Ÿฌ ์—†์Œ.

3์›” 9, 2025ยท 4 min read
From OpenAI Whisper to Your In-House ASR Service: Recognizing Name Entities & Domain-Specific Terms
Tutorials

OpenAI Whisper์—์„œ ์ž์ฒด ASR ์„œ๋น„์Šค๋กœ: ์ด๋ฆ„ ์—”ํ‹ฐํ‹ฐ ๋ฐ ๋„๋ฉ”์ธ๋ณ„ ์šฉ์–ด ์ธ์‹

Whisper๋Š” ์ฆ‰์‹œ ์ธ์ƒ์ ์ด์ง€๋งŒ, ์‹ค์ œ๋กœ ํ”„๋กœ๋•์…˜์— ๋ฐฐํฌํ•œ ์‚ฌ๋žŒ์ด๋ผ๋ฉด ๋ˆ„๊ตฌ๋‚˜ ๊ณ ํ†ต์„ ์•Œ๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค: ๊ณ ์œ ๋ช…์‚ฌ, ์ œํ’ˆ ์ด๋ฆ„, ์˜๋ฃŒ ์šฉ์–ด, ๋ฒ•๋ฅ  ์šฉ์–ด, ๊ทธ๋ฆฌ๊ณ  ๋„๋ฉ”์ธ ์–ดํœ˜์˜ ์ „์ฒด ๊ธด ๊ผฌ๋ฆฌ๋ฅผ ์ž˜๋ชป ์ฒ˜๋ฆฌํ•ฉ๋‹ˆ๋‹ค

12์›” 20, 2024ยท 1 min read
Google Researcher's In-Depth Analysis on End-to-End Speech Recognition, Part 1: Overview & Modeling
Tutorials

Google ์—ฐ๊ตฌ์›์˜ End-to-End ์Œ์„ฑ ์ธ์‹์— ๋Œ€ํ•œ ์‹ฌ์ธต ๋ถ„์„, Part 1: ๊ฐœ์š” & ๋ชจ๋ธ๋ง

๋”ฅ๋Ÿฌ๋‹์˜ 10๋…„์€ ASR ๋‹จ์–ด ์˜ค๋ฅ˜์œจ์„ 50% ์ด์ƒ ์ƒ๋Œ€์ ์œผ๋กœ ๊ฐ์†Œ์‹œ์ผฐ๊ณ , ๊ทธ ๊ณผ์ •์—์„œ ๊ณ ์ „์ ์ธ HMM ํŒŒ์ดํ”„๋ผ์ธ์„ ์œ ๋ฌผ์ฒ˜๋Ÿผ ๋ณด์ด๊ฒŒ ๋งŒ๋“ค์—ˆ์Šต๋‹ˆ๋‹ค.

6์›” 7, 2024ยท 1 min read
Google's Universal Speech Model for 100+ languages beats OpenAI's Whisper Model
Tutorials

Google์˜ 100๊ฐœ ์ด์ƒ ์–ธ์–ด๋ฅผ ์ง€์›ํ•˜๋Š” Universal Speech Model์ด OpenAI์˜ Whisper Model์„ ๋Šฅ๊ฐ€ํ•ฉ๋‹ˆ๋‹ค

Google์˜ Universal Speech Model์€ ์กฐ์šฉํžˆ ๋†€๋ผ์šด ์„ฑ๊ณผ๋ฅผ ๋‹ฌ์„ฑํ–ˆ์Šต๋‹ˆ๋‹ค: ๋ ˆ์ด๋ธ”์ด ์ง€์ •๋œ ํ›ˆ๋ จ ๋ฐ์ดํ„ฐ์˜ ์•ฝ 1/7์„ ์‚ฌ์šฉํ•˜๋ฉด์„œ 100๊ฐœ ์ด์ƒ์˜ ์–ธ์–ด์—์„œ OpenAI์˜ Whisper์™€ ๋™๋“ฑํ•˜๊ฑฐ๋‚˜ ๋Šฅ๊ฐ€ํ•˜๋Š” ASR ์„ฑ๋Šฅ์„ ๋‹ฌ์„ฑํ–ˆ์Šต๋‹ˆ๋‹ค.

5์›” 6, 2024ยท 1 min read
Long Review: Apple's MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training
Tutorials

๊ธด ๋ฆฌ๋ทฐ: Apple์˜ MM1: ๋ฉ€ํ‹ฐ๋ชจ๋‹ฌ LLM ์‚ฌ์ „ ํ•™์Šต์˜ ๋ฐฉ๋ฒ•, ๋ถ„์„ ๋ฐ ์ธ์‚ฌ์ดํŠธ

Apple์€ ๋งŽ์ด ์ถœํŒํ•˜์ง€ ์•Š์œผ๋ฏ€๋กœ, MM1 ๋…ผ๋ฌธ์ด ๋ฉ€ํ‹ฐ๋ชจ๋‹ฌ LLM ์‚ฌ์ „ ํ•™์Šต์— ๋Œ€ํ•œ ์™„์ „ํ•œ ์ œ๊ฑฐ ์—ฐ๊ตฌ์™€ ํ•จ๊ป˜ ๋ฐœํ‘œ๋˜์—ˆ์„ ๋•Œ, MLLM์„ ๊ตฌ์ถ•ํ•˜๋Š” ๋ชจ๋“  ์‚ฌ๋žŒ์—๊ฒŒ ์˜ฌํ•ด ๋” ์œ ์šฉํ•œ ๋ฐ์ดํ„ฐ ๋ฆด๋ฆฌ์Šค ์ค‘ ํ•˜๋‚˜์˜€์Šต๋‹ˆ๋‹ค.

3์›” 31, 2024ยท 1 min read
A Quick Review of Apple's SOTA Multimodal LLM: MM1
Tutorials

Apple์˜ SOTA ๋ฉ€ํ‹ฐ๋ชจ๋‹ฌ LLM์˜ ๋น ๋ฅธ ๋ฆฌ๋ทฐ: MM1

MM1์˜ ์ „์ฒด ๋ถ„์„์— ์‹œ๊ฐ„์ด ์—†๋‹ค๋ฉด, ์ด ๋น ๋ฅธ ๋ฆฌ๋ทฐ๋Š” ๋ช‡ ๋ถ„ ์•ˆ์— ํ•ต์‹ฌ์„ ์ œ๊ณตํ•ฉ๋‹ˆ๋‹ค: Apple์ด ๊ตฌ์ถ•ํ•œ ๊ฒƒ, ์•„ํ‚คํ…์ฒ˜ ๋ฐ ๋ฐ์ดํ„ฐ์˜ ์ œ๊ฑฐ ์—ฐ๊ตฌ์—์„œ ๋ฐฐ์šด ๊ฒƒ, ๊ทธ๋ฆฌ๊ณ  ์–ด๋–ค ์„ค๊ณ„ ๊ฒฐ์ •์ด

3์›” 24, 2024ยท 1 min read
The Secret That Made Claude 3 Trump GPT-4
Tutorials

Claude 3์ด GPT-4๋ฅผ ๋Šฅ๊ฐ€ํ•˜๊ฒŒ ๋งŒ๋“  ๋น„๊ฒฐ

Claude 3 Opus๊ฐ€ MMLU, GPQA, GSM8K ๋ฐ ๋Œ€๋ถ€๋ถ„์˜ ๊ฒฝ๊ณ„ ํ‰๊ฐ€ ๋ฒค์น˜๋งˆํฌ์—์„œ GPT-4๋ฅผ ๋Šฅ๊ฐ€ํ–ˆ์„ ๋•Œ, ํฅ๋ฏธ๋กœ์šด ์งˆ๋ฌธ์€ Anthropic์ด ๋‹จ์ˆœํžˆ ๋” ํฌ๊ฒŒ ํ™•์žฅํ–ˆ๋Š”์ง€ ์—ฌ๋ถ€๊ฐ€ ์•„๋‹ˆ๋ผ ์–ด๋–ค ํ•™์Šต ์‹œ๊ฐ„ ๋น„๊ฒฐ์ด์—ˆ๋Š”์ง€์˜€์Šต๋‹ˆ๋‹ค.

3์›” 8, 2024ยท 1 min read
A Review of Microsoft+OpenAI, Google, Meta, and Nvidia's Open Source Large Speech Models for ASR
Tutorials

Microsoft+OpenAI, Google, Meta, ๋ฐ Nvidia์˜ ์˜คํ”ˆ ์†Œ์Šค ๋Œ€๊ทœ๋ชจ ์Œ์„ฑ ๋ชจ๋ธ ๊ฒ€ํ† (ASR์šฉ)

๋ชจ๋“  ์ฃผ์š” AI ์—ฐ๊ตฌ์†Œ๋Š” ์ด์ œ ASR์šฉ ์˜คํ”ˆ ์†Œ์Šค ๋Œ€๊ทœ๋ชจ ์Œ์„ฑ ๋ชจ๋ธ์„ ์ถœ์‹œํ–ˆ์œผ๋ฉฐ, ํ”„๋กœ๋•์…˜์šฉ์œผ๋กœ ์˜ฌ๋ฐ”๋ฅธ ๋ชจ๋ธ์„ ์„ ํƒํ•˜๋Š” ๊ฒƒ์ด ์‹ค์ œ ๊ฒฐ์ •์ด ๋˜์—ˆ์Šต๋‹ˆ๋‹ค.

2์›” 9, 2024ยท 1 min read
From OpenAI's Whisper Model to Your Own In-House ASR Service: Postprocessing and Language Modeling
Tutorials

OpenAI์˜ Whisper ๋ชจ๋ธ์—์„œ ์ž์‹ ์˜ ์ž์ฒด ASR ์„œ๋น„์Šค๋กœ: ํ›„์ฒ˜๋ฆฌ ๋ฐ ์–ธ์–ด ๋ชจ๋ธ๋ง

์›๋ณธ Whisper ์ถœ๋ ฅ์€ ๊ธฐ๋ณธ ์ƒํƒœ์—์„œ ์ธ์ƒ์ ์ด์ง€๋งŒ, ์‹ค์ œ ์‚ฌ์šฉ์ž์—๊ฒŒ ๋ฐฐํฌํ•œ ๋ชจ๋“  ์‚ฌ๋žŒ์€ ๋ฐ๋ชจ ํŠธ๋žœ์Šคํฌ๋ฆฝํŠธ์™€ ๋‹ค์šด์ŠคํŠธ๋ฆผ ์‹œ์Šคํ…œ์ด ์‹ค์ œ๋กœ ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ๋Š” ๊ฒƒ ์‚ฌ์ด์˜ ๊ฐ„๊ฒฉ์„ ์•Œ๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค.

1์›” 12, 2024ยท 1 min read
From OpenAI's Whisper Model to Your Own In-House ASR Service: Long Audio and Streaming (Part 3)
Tutorials

OpenAI์˜ Whisper ๋ชจ๋ธ์—์„œ ์ž์‹ ์˜ ์ž์ฒด ASR ์„œ๋น„์Šค๋กœ: ๊ธด ์˜ค๋””์˜ค ๋ฐ ์ŠคํŠธ๋ฆฌ๋ฐ (Part 3)

Whisper๋Š” 30์ดˆ ์ฒญํฌ๋กœ ํ•™์Šต๋˜์—ˆ์œผ๋ฉฐ, 2์‹œ๊ฐ„ ํŒŸ์บ์ŠคํŠธ๋ฅผ ์ž…๋ ฅํ•˜๊ฑฐ๋‚˜ ๋ผ์ด๋ธŒ ์บก์…˜ ํŒŒ์ดํ”„๋ผ์ธ์— ์—ฐ๊ฒฐํ•˜๋ ค๊ณ  ํ•  ๋•Œ ํ•œ๊ณ„๋ฅผ ๋“œ๋Ÿฌ๋ƒ…๋‹ˆ๋‹ค.

12์›” 15, 2023ยท 1 min read
From OpenAI's Whisper Model to Your Own In-House ASR Service: ROI (Return-on-Investment) (Part 2)
Tutorials

OpenAI์˜ Whisper ๋ชจ๋ธ์—์„œ ์ž์‹ ์˜ ์ž์ฒด ASR ์„œ๋น„์Šค๋กœ: ROI (ํˆฌ์ž ์ˆ˜์ต๋ฅ ) (Part 2)

ASR์˜ ๊ตฌ์ถ• ๋Œ€ ๊ตฌ๋งค ์งˆ๋ฌธ์€ ์ผ๋ฐ˜์ ์œผ๋กœ ์ •ํ™•๋„ ๋Œ€ ํŽธ์˜์„ฑ์œผ๋กœ ํ”„๋ ˆ์ž„ํ™”๋˜์ง€๋งŒ, ์‹ค์ œ ๊ฒฐ์ • ์š”์†Œ๋Š” ์ œํ’ˆ ์ˆ˜๋ช… ๋™์•ˆ์˜ ROI์ž…๋‹ˆ๋‹ค.

12์›” 2, 2023ยท 1 min read
From OpenAI's Whisper Model to Your Own In-House ASR Service: Overview (Part 1)
Tutorials

OpenAI์˜ Whisper ๋ชจ๋ธ์—์„œ ์ž์‹ ์˜ ์ž์ฒด ASR ์„œ๋น„์Šค๋กœ: ๊ฐœ์š” (Part 1)

OpenAI๊ฐ€ Whisper๋ฅผ ์˜คํ”ˆ์†Œ์Šค๋กœ ๊ณต๊ฐœํ–ˆ์„ ๋•Œ, ์ž์ฒด ASR ์„œ๋น„์Šค๊ฐ€ ์–ด๋–ป๊ฒŒ ๋ณด์ด๋Š”์ง€์— ๋Œ€ํ•œ ๊ธฐ์ค€์„ ์„ ์กฐ์šฉํžˆ ์žฌ์„ค์ •ํ–ˆ์Šต๋‹ˆ๋‹ค.

11์›” 3, 2023ยท 1 min read
Why word timestamps generated by OpenAI Whisper are not accurate? How to make them accurate again?
Tutorials

OpenAI Whisper๊ฐ€ ์ƒ์„ฑํ•œ ๋‹จ์–ด ํƒ€์ž„์Šคํƒํ”„๊ฐ€ ์ •ํ™•ํ•˜์ง€ ์•Š์€ ์ด์œ ๋Š”? ๋‹ค์‹œ ์ •ํ™•ํ•˜๊ฒŒ ๋งŒ๋“ค ์ˆ˜ ์žˆ์„๊นŒ?

Whisper์— ๋‹จ์–ด ํƒ€์ž„์Šคํƒํ”„๋ฅผ ์š”์ฒญํ•˜๋ฉด ์ˆซ์ž๊ฐ€ ๋ฐ˜ํ™˜๋ฉ๋‹ˆ๋‹ค โ€” ํ•˜์ง€๋งŒ ์‹ค์ œ ์˜ค๋””์˜ค์™€ ๋งž์ถฐ๋ณด๋ ค๊ณ  ์‹œ๋„ํ•œ ๊ฒฝํ—˜์ด ์žˆ๋‹ค๋ฉด, ๋…ธ๋ž˜๋ฐฉ, ์ž๋ง‰, ๋”๋น™์„ ์œ„ํ•ด ๋“œ๋ฆฌํ”„ํŠธ๊ฐ€ ๋ฐœ์ƒํ•˜๊ณ  ์ž˜๋ชป๋œ ๊ฒฝ๊ณ„๋กœ ์Šค๋ƒ…๋˜๋ฉฐ ๊ฐ€๋”์€

10์›” 20, 2023ยท 1 min read
Speech Generative AI: VoiceBox by Meta AI (also Flow Matching and Neural ODE)
Tutorials

์Œ์„ฑ ์ƒ์„ฑ AI: Meta AI์˜ VoiceBox(Flow Matching๊ณผ Neural ODE๋„)

์ˆ˜๋…„ ๋™์•ˆ ์Œ์„ฑ ์ƒ์„ฑ์€ ๊ทœ๋ชจ์™€ ์ผ๋ฐ˜์„ฑ ์ธก๋ฉด์—์„œ ํ…์ŠคํŠธ ๋ฐ ์ด๋ฏธ์ง€ ์ƒ์„ฑ์— ๋’ค๋–จ์–ด์กŒ์Šต๋‹ˆ๋‹ค โ€” ๋ชจ๋“  ์ž‘์—…์€ ์ž์ฒด ๋งž์ถคํ˜• ๋ชจ๋ธ์„ ์‚ฌ์šฉํ–ˆ์Šต๋‹ˆ๋‹ค.

9์›” 14, 2023ยท 1 min read
A Review of SpeechT5: Introducing Google's T5 into Speech (ASR, TTS, SID, ...) Tasks
Tutorials

SpeechT5 ๋ฆฌ๋ทฐ: ์Œ์„ฑ(ASR, TTS, SID, ...) ์ž‘์—…์— Google์˜ T5 ๋„์ž…ํ•˜๊ธฐ

T5๋Š” ๋‹จ์ผ ์ธ์ฝ”๋”-๋””์ฝ”๋” ์‚ฌ์ „ ํ›ˆ๋ จ ๋ฐฉ์‹ ์•„๋ž˜์—์„œ ํ…์ŠคํŠธ-ํ…์ŠคํŠธ ์ž‘์—…์„ ํ†ตํ•ฉํ–ˆ์œผ๋ฉฐ NLP์˜ ํ•ต์‹ฌ ๋„๊ตฌ๊ฐ€ ๋˜์—ˆ์Šต๋‹ˆ๋‹ค.

5์›” 20, 2023ยท 1 min read
A Review of Deepmind's WaveNet for TTS/Audio Synthesis (Does it look like GPT to you?)
Tutorials

Deepmind์˜ WaveNet TTS/์˜ค๋””์˜ค ํ•ฉ์„ฑ ๋ฆฌ๋ทฐ (๋‹น์‹ ์—๊ฒŒ GPT์ฒ˜๋Ÿผ ๋ณด์ด๋‚˜์š”?)

Tacotron ์ด์ „์—, VALL-E ์ด์ „์—, ์‹ ๊ฒฝ ์ฝ”๋ฑ์ด ์˜ค๋””์˜ค๋ฅผ ํ† ํฐ์œผ๋กœ ๋ณ€ํ™˜ํ•˜๊ธฐ ์ด์ „์—, DeepMind์˜ WaveNet์€ ์‹ ๊ฒฝ๋ง์ด ์›๋ณธ ์˜ค๋””์˜ค ํŒŒํ˜•์„ ์ƒ˜ํ”Œ ๋‹จ์œ„๋กœ ์ƒ์„ฑํ•  ์ˆ˜ ์žˆ์Œ์„ ๋ณด์—ฌ์ค€ ๋…ผ๋ฌธ์ด์—ˆ๊ณ  ๋ชจ๋“  ๋งค๊ฐœ๋ณ€์ˆ˜์‹

5์›” 6, 2023ยท 1 min read
In-depth Review of Google's SoundStream: An End-to-End Neural Audio Codec
Tutorials

Google์˜ SoundStream ์‹ฌ์ธต ๋ฆฌ๋ทฐ: ์—”๋“œ-ํˆฌ-์—”๋“œ ์‹ ๊ฒฝ ์˜ค๋””์˜ค ์ฝ”๋ฑ

์‹ ๊ฒฝ ์ฝ”๋ฑ์€ ์กฐ์šฉํžˆ ํ˜„๋Œ€ ์ƒ์„ฑ ์˜ค๋””์˜ค์˜ ๊ธฐ์ดˆ ๊ณ„์ธต์ด ๋˜์—ˆ๊ณ , SoundStream์€ ์‹œ์ž‘์„ ์‹ ํ˜ธํ•œ ๋…ผ๋ฌธ ์ค‘ ํ•˜๋‚˜์ž…๋‹ˆ๋‹ค.

4์›” 8, 2023ยท 1 min read
[Olewave's Review] AudioLM: a Language Modeling Approach to Audio Generation
Tutorials

[Olewave์˜ ๋ฆฌ๋ทฐ] AudioLM: ์˜ค๋””์˜ค ์ƒ์„ฑ์„ ์œ„ํ•œ ์–ธ์–ด ๋ชจ๋ธ๋ง ์ ‘๊ทผ

AudioLM์€ ๋งŽ์€ ์‚ฌ๋žŒ๋“ค์—๊ฒŒ ์˜ค๋””์˜ค ์ƒ์„ฑ์ด ์‹ ํ˜ธ ์ฒ˜๋ฆฌ๋ณด๋‹ค๋Š” ์–ธ์–ด ๋ชจ๋ธ๋ง์ฒ˜๋Ÿผ ๋ณด์—ฌ์•ผ ํ•œ๋‹ค๊ณ  ํ™•์‹ ์‹œํ‚จ ๋…ผ๋ฌธ์ž…๋‹ˆ๋‹ค.

3์›” 11, 2023ยท 1 min read
[10 mins] Explain Why OpenAI's Whisper API Isn't As Good As ChatGPT
Tutorials

[10๋ถ„] OpenAI์˜ Whisper API๊ฐ€ ChatGPT๋งŒํผ ์ข‹์ง€ ์•Š์€ ์ด์œ  ์„ค๋ช…

Whisper๋Š” ํฐ ์„ฑ๊ณต์„ ๊ฑฐ๋‘์—ˆ์ง€๋งŒ, GPT-3์ด NLP๋ฅผ ์žฌํŽธํ–ˆ๋˜ ๋ฐฉ์‹์œผ๋กœ ASR์„ ์žฌํŽธํ•˜์ง€๋Š” ๋ชปํ–ˆ์Šต๋‹ˆ๋‹ค. ์ด 10๋ถ„์งœ๋ฆฌ ๋ฆฌ๋ทฐ๋Š” ๊ทธ ์ด์œ ๊ฐ€ ๋…ผ๋ฌธ ์ž์ฒด์— ๋‚ด์žฌ๋˜์–ด ์žˆ๋‹ค๊ณ  ์ฃผ์žฅํ•ฉ๋‹ˆ๋‹ค.

3์›” 4, 2023ยท 1 min read
In-depth review of OpenAI's GPT-3 : Language Models are Few-Shot Learners (Part 1/3: Intro&Approach)
Tutorials

OpenAI์˜ GPT-3์— ๋Œ€ํ•œ ์‹ฌ์ธต ๊ฒ€ํ† : ์–ธ์–ด ๋ชจ๋ธ์€ Few-Shot ํ•™์Šต์ž์ž…๋‹ˆ๋‹ค (ํŒŒํŠธ 1/3: ์†Œ๊ฐœ & ์ ‘๊ทผ)

์ด ์„ธ ๋ถ€๋ถ„ GPT-3 ๊ฒ€ํ† ์˜ ์ฒซ ๋ฒˆ์งธ ๋ถ€๋ถ„์€ ๊ทœ๋ชจ๋ฅผ ์—ฐ๊ตฌ ๋ฒ ํŒ…์—์„œ ์—…๊ณ„ ๋ณต์Œ์œผ๋กœ ๋ฐ”๊พผ ๋…ผ๋ฌธ์„ ์„ค์ •ํ•ฉ๋‹ˆ๋‹ค.

2์›” 11, 2023ยท 1 min read
In-depth Review of VALL-E: Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers
Tutorials

VALL-E์˜ ์‹ฌ์ธต ๋ฆฌ๋ทฐ: ์‹ ๊ฒฝ ์ฝ”๋ฑ ์–ธ์–ด ๋ชจ๋ธ์ด ์˜์ƒท ํ…์ŠคํŠธ ์Œ์„ฑ ํ•ฉ์„ฑ๊ธฐ

3์ดˆ ์ฐธ๊ณ  ํด๋ฆฝ์œผ๋กœ๋ถ€ํ„ฐ์˜ ์˜์ƒท TTS๋Š” VALL-E๊ฐ€ ์ถœ์‹œ๋  ๋•Œ๊นŒ์ง€ ๋ถˆ๊ฐ€๋Šฅํ•ด ๋ณด์˜€์ง€๋งŒ, ์ด ์‹ฌ์ธต ๋ฆฌ๋ทฐ๋Š” Microsoft๊ฐ€ ์ •ํ™•ํžˆ ์–ด๋–ป๊ฒŒ ์ด๋ฅผ ๋‹ฌ์„ฑํ–ˆ๋Š”์ง€๋ฅผ ์ƒ์„ธํžˆ ์„ค๋ช…ํ•ฉ๋‹ˆ๋‹ค.

2์›” 4, 2023ยท 1 min read
Understand Microsoft's VALL-E in 3 Minutes (SOTA Zero-shot TTS)
Tutorials

3๋ถ„ ์•ˆ์— Microsoft์˜ VALL-E ์ดํ•ดํ•˜๊ธฐ (์ตœ๊ณ  ์„ฑ๋Šฅ ์˜์ƒท TTS)

VALL-E๋Š” TTS๊ฐ€ ์‹ ํ˜ธ ํšŒ๊ท€์ฒ˜๋Ÿผ ๋ณด์ด๊ธฐ๋ฅผ ๋ฉˆ์ถ”๊ณ  ์–ธ์–ด ๋ชจ๋ธ๋ง์ฒ˜๋Ÿผ ๋ณด์ด๊ธฐ ์‹œ์ž‘ํ•œ ์ˆœ๊ฐ„์ด๋ฉฐ, ์ด ๋น ๋ฅธ ์„ค๋ช…์€ ๋‹น์‹ ์„ ์‹ ์†ํ•˜๊ฒŒ ์ดํ•ดํ•˜๋„๋ก ๋„์™€์ค๋‹ˆ๋‹ค.

2์›” 4, 2023ยท 1 min read
[Olewave's Review] OpenAI's Whisper ASR: Robust Speech Recognition via Large-Scale Weak Supervision
Tutorials

[Olewave์˜ ๋ฆฌ๋ทฐ] OpenAI์˜ Whisper ASR: ๋Œ€๊ทœ๋ชจ ์•ฝํ•œ ์ง€๋„๋ฅผ ํ†ตํ•œ ๊ฐ•๊ฑดํ•œ ์Œ์„ฑ ์ธ์‹

OpenAI๊ฐ€ Whisper๋ฅผ ์ถœ์‹œํ–ˆ์„ ๋•Œ, ASR ์ปค๋ฎค๋‹ˆํ‹ฐ๋Š” 68๋งŒ ์‹œ๊ฐ„์˜ ๋‹ค๊ตญ์–ด, ๋‹ค์ค‘ ์ž‘์—…, ์›น ํฌ๋กค๋ง ์˜ค๋””์˜ค๋กœ ํ›ˆ๋ จ๋˜์–ด ์‚ฌํˆฌ๋ฆฌ, ๋ฐฐ๊ฒฝ ์†Œ์Œ, ๊ธฐ์ˆ  ์šฉ์–ด ์ „๋ฐ˜์— ๊ฑธ์ณ

10์›” 31, 2022ยท 1 min read
Olewave's most detailed illustration of RNN-T: Sequence Transduction with Recurrent Neural Networks
Tutorials

Olewave์˜ RNN-T ์„ค๋ช… ์ค‘ ๊ฐ€์žฅ ์ƒ์„ธํ•จ: Sequence Transduction with Recurrent Neural Networks

Alex Graves์˜ RNN-T ๋…ผ๋ฌธ์€ ์˜ค๋Š˜๋‚  ์ถœ์‹œ๋˜๋Š” ๊ฑฐ์˜ ๋ชจ๋“  ์ŠคํŠธ๋ฆฌ๋ฐ ASR ์‹œ์Šคํ…œ์˜ ์กฐ์šฉํ•œ ์กฐ์ƒ์ด๋ฉฐ, Google์˜ ์˜จ๋””๋ฐ”์ด์Šค ์ธ์‹๊ธฐ์—์„œ๋ถ€ํ„ฐ NeMo, ESPnet ๋“ฑ์˜ ์ˆ˜๋งŽ์€ ์˜คํ”ˆ์†Œ์Šค ํŠธ๋žœ์Šค๋“€์„œ ์Šคํƒ์— ์ด๋ฅด๊ธฐ๊นŒ์ง€์ž…๋‹ˆ๋‹ค.

9์›” 3, 2022ยท 1 min read
[Olewave's Long Review] Efficient Training of Neural Transducer for Speech Recognition
Tutorials

[Olewave์˜ ๋กฑ ๋ฆฌ๋ทฐ] ์Œ์„ฑ ์ธ์‹์„ ์œ„ํ•œ ์‹ ๊ฒฝ ํŠธ๋žœ์Šค๋“€์„œ์˜ ํšจ์œจ์ ์ธ ํ›ˆ๋ จ

์‹ ๊ฒฝ ํŠธ๋žœ์Šค๋“€์„œ๋Š” ์ŠคํŠธ๋ฆฌ๋ฐ ASR์˜ ์ฃผ๋ ฅ์ด์ง€๋งŒ, ํšจ์œจ์ ์œผ๋กœ ํ›ˆ๋ จํ•˜๋Š” ๊ฒƒ์€ ์œ ๋ช…ํ•˜๊ฒŒ ๊ณ ํ†ต์Šค๋Ÿฝ์Šต๋‹ˆ๋‹ค: RNN-T ์†์‹ค์€ ์‹œํ€€์Šค ๊ธธ์ด์—์„œ 3์ œ๊ณฑ ๋ฉ”๋ชจ๋ฆฌ๋ฅผ ๊ฐ€์ง€๋ฉฐ, ์ •๋ ฌ ๊ฒฉ์ž๋Š” ๊ธด ๋ฐœํ™”์—์„œ ํญ๋ฐœํ•˜๊ณ , ๋‹จ์ผ-

7์›” 23, 2022ยท 1 min read
[Long Review] Conformer: Convolution-augmented Transformer for Speech Recognition
Tutorials

[์žฅ๋ฌธ ๋ฆฌ๋ทฐ] Conformer: ์Œ์„ฑ ์ธ์‹์„ ์œ„ํ•œ Convolution-augmented Transformer

Conformer๋Š” end-to-end ASR์„ ์กฐ์šฉํžˆ ์žฅ์•…ํ•œ ๋ชจ๋ธ์ด๋ฉฐ, ๋ชจ๋“  Transformer ๋ธ”๋ก์— convolution ๋ชจ๋“ˆ์„ ์ถ”๊ฐ€ํ•˜๋Š” ๊ทธ ๋ฐฉ์‹์€ ๋‹จ์ˆœํ•˜์ง€๋งŒ ๋†€๋ž๊ฒŒ๋„ ์ž˜ ์ž‘๋™ํ•˜๋Š” ์•„์ด๋””์–ด ์ค‘ ํ•˜๋‚˜์ž…๋‹ˆ๋‹ค.

6์›” 11, 2022ยท 1 min read