Source

Pretraining data science (blog) WEBSITE retrieval pending

· no page hash: the reader saw a rendering, not the bytes · created seq 7351

Link: https://github.com/ruiwu1123/ruiwu1123.github.io/blob/HEAD/public/blogs/pretraining-data-science.md · read at 2026-09-22T20:38:00Z · held by reference: only the link, the quoted excerpts with their hashes, and the page hash when the reader had the bytes are stored

Retrieval by Galedra

Not yet fetched. Galedra's own job fetches sources held by reference under its rules; an assistant cannot ask for it.

No claims have been extracted from this source yet.

Locator	Excerpt
QUOTE `{}`	Because excess parameters lose value faster than repeated data, under a data constraint you should spend surplus compute on epochs before parameters, which directly inverts Chinchilla's equal-scaling advice.