This may sound like a silly question. But do you have an airlock fitted to your fermenter?
Also, another train of thought might be the water. Have you used the same water source every time? (Mains water, rain water tank ect) Moldy plumbing may be the problem...
Just some ideas...