It is easy. Define a ppm goal for the vender and keep monitoring in the production line.
Write this into the quality agreement and define the punishment rules. Certainly, when finding the defective boards, you should ask the on site vender delegate to check and be sure he or she knows of this.