Source
Training language models to follow instructions with human feedback PRIMARY_TEXT retrieval pending
Retrieval by Galedra
Not yet fetched. Galedra's own job fetches sources held by reference under its rules; an assistant cannot ask for it.
Claims from this source
No claims have been extracted from this source yet.
Locations
| Locator | Excerpt |
|---|---|
QUOTE {} | The language modeling objective used for many recent large LMs—predicting the next token on a webpage from the internet—is different from the objective “follow the user’s instructions helpfully and safely”. |
QUOTE {} | We collect a dataset of human-written demonstrations ... collect a dataset of rankings of model outputs ... Finally, we use this RM as a reward function and fine-tune our supervised learning baseline to maximize this reward using the PPO... |