Hi,
I would put back the screw in to hold properly the plexi back in place.
Just screw them until the head touch the plexi, not thightening them on the plexi.
When you put the caulking, around the opening, put toward the inside of the screw holes. No water will endup leaking inside the boat.