Port Burwell - best time to go

I have been three times so far, I loved the place. Unfortunately, I can only drop by for an hour or two at a time. So far, I only visited around 6pm - there were maybe around 50 people, 3/4 men. When is the best time to go in terms of numbers and gender/age diversity?