Yes, a light scuff for adhesion then spray on the primer, you should be fine. Of course you need to prep the area before sanding as mentioned earlier. If you do bust thru the top coat into bare metal, then you need to touch up that spot to protect it from rust, then prime.
Or you could use...