Depends on what the exterior is made of. We use denatured alcohol, or a product called acryl-sol (sp).
FWIW, I wouldn't reseal the windows without removing them. If the sealant is dripping down the sides, it will continue to do that until you remove the window and clean the stuff off the flange. Been there done that on many trailers.
2012 Copper Canyon 273FWRET being towed by a 1994 Ford F350 CC,LB,Dually diesel.
Airlift 5000 bags, Prodigy brake control, 5 gauges on the pillar.Used to tow a '97 Jayco 323RKS.
Now an RVIA registered tech. Retired from Law enforcement in 2008 after 25+ yrs.