Fun events that get men together can have a "huge" affect on their mental wellbeing, a charity says.