So how do you fix it? Well, you get something like Super Corona Dope, which is a high voltage sealant. I picked up a bottom from the local Frys Electronics that will probably last me the rest of my life.
It smells a lot like fingernail polish, and is applied the same way...
I applied a couple of coats as the first couple of coats filled in the crack and air bubbles came out. I wanted to make sure it was completely sealed.
I'm going to let it dry over night, then we'll hook it up and see if we get any fireworks... hopefully not.