Platform is moving the generator behind a vendor API th...

The requirement was never the specific metric, but the observability of the system. You can use N-sample agreement at multiple decodes as a coarse substitute or use an open-weight shadow model as a canary. Most importantly, treat observability as a procurement requirement; ensure log-probability access is included in the vendor contract to ensure long-term system health.