I can't hear any clicks other than the switch itself.
I've just discovered something though, contrary to what I said earlier the dripping doesn't start until after I've switched the pump on. So when turned on everything is as it should be, then it delivers the coffee but doesn't shut off the water supply to the dispenser properly. Also when I said before that there is clean water coming out at the same time as the coffee that must imply that the water is coming from somewhere other than the bit that goes into the coffee spout.
Following your other suggestion I discovered something else, once the water has been dripping for a while the top plate gets stupidly hot, almost burned myself when I tried to turn the steam knob. Much hotter than normal. When steam is coming out the dripping stops but starts again as soon as I turn the steam off, and just like before continues to drip until I turn off the power.