We decided to paint the windows white to match our replacement vinyl window (future post). Taping off the glass was easy enough then we painted them with rustoleum paint+primer.
I should have used a LOT more glue. The key is to spread it out across the entire surface of the plywood. It turned out ok but isn't as smooth as I would like.