Sometimes the grade of stainless on the hardware in not up to snuff. The running rust will continue until you replace them with a quality pair. Until then you can use
Barkeepers Friend It won't hurt your paint. Use the liquid form and rub gently. It should disappear in a few seconds. I buy it at Ace Hardware