My instructions say rinse brush on your way past it when soaping car up w/hp. A freshly rinsed plastic brush won't scratch.
I am not saying it is impossible, but are you sure the scratches were from the brush? I've seen many cars scratched up from dealers wiping them down., removing snow...