You're site is more of a fun site like you say and so maybe more of the traffic you get could be quality traffic. But what about the person who has no sense of humor or the person not looking for fun.

Even for a fun site there is still a target market. Not everyone will like your site no matter what you do. Your goal is to try to get the people most likely to enjoy the site to visit.

just a follow up question...how can you acquire relevant links?