I'll agree with this, if I wear a hat, its my sweatstained, worn in, loved, sun bleached worn all over the globe authentic 5950 [no new era logo on the side] that is molded perfectly to my head that I've been wearing for 10 years. This is hands down, my most valuable piece of clothing I own. Nothing could replace it as years are required to get the hat the way I like it.
Would I wear this to a club or something nice? No, probably not if I'm trying to dress next level, you have to best judge the situation to avoid looking juvenile. Other than that I'd just skip the hat. A pork pie or fedora does look nice and classic on some, but overall I think it is silly and a style best suited for more seasoned folk. That said I've seen it look good but for out and about, the gym, work, school, casual party, whatever, rock the baseball cap.
As a general rule, post college, you should restrict your hat to more and more casual settings. Older you get, the more casual setting it should be but you are never too old for your favorite baseball cap. It's fun to get off work and throw on a hat backwards when driving home for example.
Another thought: wearing a baseball hat with a suit is similarly misplaced as say wearing a fedora with sandals jeans and a t shirt.