If you can, a good solution would be to remove the window trim on the inside of the house, and inject sealing foam (available in aerosol cans) into every opening around each window frame. Let the foam harden for a few hours, trim with a sharp knife, and reinstall the trim work. This will do an amazing job for you.