My commute is super-short (1.6 miles each way), and I have good luck wearing a big loose cotton t-shirt: the wind gets underneath it and cools off my skin. The drag it creates wouldn't be acceptable on a longer commute, but it doesn't slow me down significantly.