Immoral to who though? That's the question you must ask. It might be weird to some (opinionated and uptight) Americans and other westeners, but it's just part of Japanese culture.
I actually like gym outfits with and without jackets. It's kinda cute, like on Hibari from Senran Kagura