Reptile: A scalable meta-learning algorithm
8y
- Published
- Collected
We’ve developed a simple meta-learning algorithm called Reptile which works by repeatedly sampling a task, performing stochastic gradient descent on it, and updating the initial parameters towards the final parameters learned on that task. Reptile is the application of the Shortest Descent algorithm to the meta-learning setting, and is mathematically similar to first-order MAML (which is a version of the…
overfeed.news indexes and links. We publish a short excerpt — the full article stays at OpenAI News.
More from OpenAI News
Log in to follow this source
How Amplitude ships product improvements in 1–2 days with OpenAI
Built primarily on OpenAI models, Amplitude’s proactive product agent, Wave, identifies what to build, helps teams ship changes with coding agents, and measures the impact.
Gondola doubles revenue as its team builds more with Codex
Gondola helps creatives get credit and get hired, with Codex raising its lead engineer’s output by 50% and ChatGPT simplifying daily work.
Holiday Extras is rethinking what it can build with Codex
With Codex, Holiday Extras is turning customer expertise into better apps, higher booking conversion and new possibilities for growth.
Supporting research on AI and children’s safety
OpenAI commits $2 million to research on AI and children’s safety. The work supports shared tools to measure risks and opportunities for young people.