← All questions
Data, Privacy & LegalHard· Licensing· Model Quality· Data Sourcing

Training only on permissively licensed text will wreck...

Concede the measurement gap rather than arguing against it. Show that the quality issue is one of composition, not scale, making a test-time datastore the correct instrument to close the gap. Address the ‘filter and retrain’ argument by pointing to historical examples like Books3, where models retained data even after the source dataset was removed.

Code playground (Python)