Learning from human preferences
9y
- Published
- Collected
One step towards building safe AI systems is to remove the need for humans to write goal functions, since using a simple proxy for a complex goal, or getting the complex goal a bit wrong, can lead to undesirable and even dangerous behavior. In collaboration with DeepMind’s safety team, we’ve developed an algorithm which can infer what humans want by…
overfeed.news indexes and links. We publish a short excerpt — the full article stays at OpenAI News.
More from OpenAI News
Log in to follow this sourceFranchisee reconciles cash in 94% less time with ChatGPT Work
An independent Schlotzsky’s and Cinnabon franchisee cut menu repricing time by 95% and built a workflow that could free up $100K in cash flow.
Terminal X matches senior investor judgment 88.6% with GPT-6.1
Terminal X’s Eval Agent grades outputs against a 54-criterion rubric, catching 25% more deviances from a fund’s mandate with GPT-6.1 Sol.
OpenAI acquires Orchestra Bio
OpenAI is acquiring Orchestra Bio to bring AI-powered operations to life sciences R&D, helping biopharma teams accelerate drug development and advance new treatments.
Advancing Coding in Low-Resource Programming Languages
Learn how OpenAI is improving ChatGPT across low-resource programming languages, with new evaluations for software engineering, SQLite, and COBOL migration.