Disclosing OpenAI GPT-4's vision+text model, data, and cost to train (speculated)
OpenAI famously refused to disclose GPT-4's architecture, parameter count, training data, or compute budget, which turned the tech report into a Rorschach test…
A Review of GPT-4's Technical Report (GPT-4 in a Nutshell)
GPT-4's technical report is famously thin on architecture details and thick on capability claims, which makes a clear-headed review essential reading for anyon…
In-depth review of OpenAI's GPT-3 : Language Models are Few-Shot Learners (Part 3/3: Results&Rest)
The final installment of this three-part GPT-3 deep dive gets to the payoff: what actually happens when you throw 175 billion parameters at a benchmark suite a…
In-depth review of OpenAI's GPT-3 : Language Models are Few-Shot Learners (Part 2/3: Results)
Part two of this GPT-3 deep dive moves past the setup and into the results that actually made people rethink NLP.
In-depth review of OpenAI's GPT-3 : Language Models are Few-Shot Learners (Part 1/3: Intro&Approach)
The opening installment of this three-part GPT-3 review sets up the paper that turned scaling from a research bet into industry gospel.
ChatGPT/ChatGPT Plus/InstructGPT:Training language models to follow instructions with human feedback
Behind the ChatGPT product sits the InstructGPT paper, and this detailed review pulls apart the pipeline that turned a raw GPT-3 into something people actually…
Explain how ChatGPT/ChatGPT Plus works in 3 minutes
ChatGPT looks like magic from the outside, but the recipe is well-documented if you know where to look, and this three-minute explainer condenses the core idea…
Google fired Blake Lemoine for saying AI bot is sentient? Does LaMDA or ChatGPT think like human?
When Google fired Blake Lemoine for going public with claims that LaMDA had become sentient, the story went viral, but the underlying question stuck around: do…