I did it as part of my PT when I was recovering from a shoulder surgery. It was great and yep, you don't overheat! Used to do aqua-aerobics when I was in school and loved it. Not being Ms. Graceful any day, I was able to blend in with everyone and not look stupid.
Good luck with it!