“Let boilerplate be boilerplate” – Dan Davies
“One of the tricks used to make transformer neural networks produce more human-sounding output is to introduce a bit of randomness (the “temperature” parameter), so that they select one of the closest few “near neighbour” tokens rather than always glomming onto the single smallest vector distance. Consideration of the function of boilerplate immediately shows why that’s problematic – as well as wasting everyone’s time trying to work out whether a minor change in verbal expression is significant, there’s a constant danger of creating something which actually does have a different effect than the boilerplate and changing contract terms by accident”
https://backofmind.substack.com/p/let-boilerplate-be-boilerplate