I usually wash after a couple of wears, mainly because I don't like the wrinkles that I get when wearing them. Also, drying them usually shrinks them and gets them back to being super snug, the way I like.
After a night at a bar/club, I have to wash them though. That's a must.