Faulty reward functions in the wild
Reinforcement learning algorithms can break in surprising, counterintuitive ways. In this post we’ll explore one failure mode, which is where you misspecify your reward function.
en
OpenAI News
1386
Universe
We’re releasing Universe, a software platform for measuring and training an AI’s general intelligence across the world’s supply of games, websites and other applications.
en
OpenAI and Microsoft
We’re working with Microsoft to start running most of our large-scale experiments on Azure.
en
Report from the self-organizing conference
Last week we hosted over a hundred and fifty AI practitioners in our offices for our first self-organizing conference on machine learning.
en
Infrastructure for deep learning
Deep learning is an empirical science, and the quality of a group’s infrastructure is a multiplier on progress. Fortunately, today’s open-source ecosystem makes it possible for anyone to build great deep learning infrastructure.
en
Machine Learning Unconference
The latest information about the Unconference is now available at the Unconference wiki, which will be periodically updated with more information for attendees.
en
Special projects
Impactful scientific work requires working on the right problems—problems which are not just interesting, but whose solutions matter.
en
Concrete AI safety problems
We (along with researchers from Berkeley and Stanford) are co-authors on today’s paper led by Google Brain researchers, Concrete Problems in AI Safety. The paper explores many research problems around ensuring that modern machine learning systems operate as intended.
en
OpenAI technical goals
OpenAI’s mission is to build safe AI, and ensure AI’s benefits are as widely and evenly distributed as possible.
en
Generative models
This post describes four projects that share a common theme of enhancing or using generative models, a branch of unsupervised learning techniques in machine learning. In addition to describing our work, this post will tell you a bit more about generative models: what they are, why they are important, and where they might be going.
en
Team update
We’d like to welcome the latest set of team members to OpenAI (and we’re still hiring!)
en