Olewave - Professional and Trustworthy - Data Services and Solutions

Tutorials

[Olewave's Review] CLIP (3/3): Learning Transferable Visual Models From Natural Language Supervision

The final part of this CLIP review lands on the results section, which is where OpenAI's contrastive image-text model shifted from an interesting idea to a fou…

Jan 14, 2023· 1 min read

Tutorials

[Olewave's Review] CLIP (2/3): Learning Transferable Visual Models From Natural Language Supervision

OpenAI's CLIP flipped the script on computer vision by tossing out fixed label sets and instead training on 400 million (image, text) pairs scraped from the in…

Jan 1, 2023· 1 min read

Tutorials

[Olewave's Review] CLIP (1/3): Learning Transferable Visual Models From Natural Language Supervision

Before there was BLIP, LLaVA, or any speech-LLM worth its salt, there was CLIP, and this is where the story begins.

Dec 17, 2022· 1 min read

Tutorials

Boris Johnson’s Rise and Fall - an analysis of the mics

Political news is not usually what voice AI engineers cue up for a Friday afternoon, but Boris Johnson's resignation announcement, delivered in front of a bank…

Jul 9, 2022· 1 min read

Tutorials

[Olewave's Long Review] Xception: Deep Learning with Depthwise Separable Convolutions

Xception took the Inception hypothesis to its logical extreme by pushing cross-channel and spatial correlations into fully separate operations, and the depthwi…

Jul 9, 2022· 1 min read

Tutorials

Dr. Fauci was caught on hot mic - 'what a moron' -- analysis from a research perspective

Dr.

Jul 2, 2022· 1 min read

Tutorials

Phased Array Radar on China's Aircraft Carrier Fujian 003 and Its Connection with Speech Beamforming

The phased array radar mounted on China's newest aircraft carrier, Fujian 003, and the microphone arrays that let your smart speaker hear you across a noisy ro…

Jun 25, 2022· 1 min read

Tutorials

How Does the All-New Dictation in iOS 16 Work? Reveal Apple's Secret Sauce by a Speech Researcher!

Apple's iOS 16 dictation runs fully on-device, and that single design choice has cascading consequences for latency, privacy, and what kinds of ASR architectur…

Jun 18, 2022· 1 min read

Tutorials

[Long Review] Conformer: Convolution-augmented Transformer for Speech Recognition

Conformer is the model that quietly took over end-to-end ASR, and its recipe, bolt a convolution module onto every Transformer block, turned out to be one of t…

Jun 11, 2022· 1 min read

Tutorials

[Long Review] Cascaded Diffusion Models for High Fidelity Image Generation

Before Imagen and DALL-E 2 made diffusion the default for generative imagery, this Google Brain paper laid out the cascaded diffusion recipe that a lot of late…

Jun 4, 2022· 1 min read

Tutorials

[Short Review] Cascaded Diffusion Models for High Fidelity Image Generation

Cascaded diffusion is the two-stage-plus recipe underneath a lot of modern generative work: generate a small image with one diffusion model, then hand it to su…

Jun 4, 2022· 1 min read

Tutorials

[Long Review] Axial Attention in Multidimensional Transformers

Full self-attention over an image or a video is prohibitively expensive, so how do you keep the expressiveness of a Transformer without the quadratic blowup?

May 28, 2022· 1 min read

Tutorials

[Short Review] Axial Attention in Multidimensional Transformers

Axial attention is one of those elegant ideas that keeps Transformers tractable on high-dimensional data: instead of attending over every pixel or every time-f…

May 28, 2022· 1 min read

Tutorials

[Long Review] Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis

This is the paper that made zero-shot voice cloning practical: train a speaker encoder on a discriminative verification task with thousands of noisy, transcrip…

May 21, 2022· 1 min read

Tutorials

[Short Review] Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis

The Google paper that kicked off the modern zero-shot voice cloning wave has a beautifully clean architecture: a speaker encoder trained on verification, a Tac…

May 21, 2022· 1 min read

Tutorials

[Short Review] Wav2Seq: Pre-training Speech-to-Text Encoder-Decoder Models Using Pseudo Languages

Self-supervised pretraining like wav2vec 2.0 gave us great speech encoders, but if you want a full encoder-decoder ASR system, the decoder was still starting f…

May 14, 2022· 1 min read

Tutorials

[Long Review] Towards Zero-Label Language Learning

What if you could train task-specific NLP models without a single human-labeled example? "Towards Zero-Label Language Learning" leans hard into that question.

May 7, 2022· 1 min read

Tutorials

[Long Review] Fully Sharded Data Parallel: faster AI training with fewer GPUs

Training a billion-parameter speech or language model on a modest GPU budget used to mean picking your poison across pipeline parallelism, tensor parallelism, …

Apr 23, 2022· 1 min read

Tutorials

[Short Review] Fully Sharded Data Parallel: faster AI training with fewer GPUs

Fully Sharded Data Parallel is Meta's answer to a question every speech and language team eventually asks: how do we train models an order of magnitude bigger …

Apr 23, 2022· 1 min read

Tutorials

[Short Review] Deduplicating Training Data Makes Language Models Better

How much of your language model's "generalization" is actually just regurgitation?

Apr 16, 2022· 1 min read

Tag: ml