Source
Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling Laws PRIMARY_TEXT
Retrieval by Galedra
FETCHED at 2026-09-28T22:59:33Z · https://proceedings.mlr.press/v235/sardana24a.html · seq 12676
| Excerpt | Finding |
|---|---|
| These formulas, including the popular DeepMind Chinchilla scaling laws, neglect to include the cost of inference. ... researchers expecting reasonably large ... | not found — this server looked at the page and did not find the passage |
Claims from this source
No claims have been extracted from this source yet.
Locations
| Locator | Excerpt |
|---|---|
QUOTE {} | These formulas, including the popular DeepMind Chinchilla scaling laws, neglect to include the cost of inference. ... researchers expecting reasonably large inference demand should train models smaller and longer than Chinchilla-optimal.... |