You don't want to take off much at all because the plastic seal retainer pieces need to hold the low pressure seal in place. As the seal casing gets shorter you'll have movement of the seal which will make it fail prematurely. I'd recommend replacing them if you have to remove more than a couple thou. If your pumps are so old that it uses a snap ring to retain the low-pressure seals, you can take them down a lot without a problem.
Observation
I pulled another Vilco Head off the shelf to make some observations on how the process is done and tolerances held. What I found relates to Meps post above. Looking at the photos below, after torquing down the seal cases with #29 oring, SS sleeves and HP seals inserted, the outside two seal cases are .070" too deep in the head and the center seal case is .100 too deep. This is because of the amount of stock taken off the HP seal face in the head. The calculation is based on the bottom of the slot in the seal case is supposed to be level with the face of the head. Not only will the LP plastic seal retainer not do its job, I'm wondering if the Seal Case Oring will seal in the 1.260" finish bore. There is a cast relief between this bore and the HP seal Bore. Measuring it out, it looks like the oring is very close to the cast relief or not sealing at all. Even if it seals ok, there is the issue with the plastic seal cases not doing their job. I know Vilco is supposed to test for pressure and leaks, but the oring will only do its job if the HP seal starts to bypass or wash out. Then I think you'd see water make it past the oring if its not seated correctly and leak out of the pump.
So to resolve, I'm either putting a SS washer of correct thickness between the seal case and HP seal so the bottom of slot ends up in the right location, or just use snap rings to hold the LP seals in place, like Mep suggested. You just need to make sure the Seal Case Oring seats correctly in the bore. If you go the snap ring route, just make sure you grind a little off the 2 loops close to the bore. They are about even with the bore and could possibly hit the ceramic plunger.
Any issues I'm missing if using SS washers in between the seal case and HP seals? They would have to be machined to the right ODxIDxthickness….