I always kept it closed.. However, I had a crack form along the seam on my previous tank.. A couple gallons ended up sitting in the back of the boat for a few days saturating my paint nicely... I'm assuming the pressure had built up enough to cause a stress crack in the tank.. Anyhow, a little more time and money to throw in my hole in the water and will be good again.. Just wondering what everyone else did....