Thank you Bizier. A few things you mention, like rinsing in boiling hot water is something I will try.
Also, when i have used the no rinse, I have only been mixing up a few litres worth in the fermenter, soaking the lid seal, spoon, airlock etc in it for a few minutes, then taking them out...