← All questions
Data, Privacy & LegalVery Hard· Model Governance· Benchmarks· Legal Compliance

Legal wants to commit contractually to removal from our...

Benchmarks like TOFU fine-tune the forget set in before removing it, which does not translate to real-world probes of unknown recall. Additionally, a dozen requests a month compounds over a year, leading to a significant percentage of retained capability loss. Instead of a blanket commitment, offer verified deletion from datastores and logs, exclusion from future training, and a dated retirement for the current checkpoint, while explicitly disclosing the residual risk.

Code playground (Python)