I take the diaphragm/insert out and chuck it after first use. Seems superfluous.
Also, I take off he plastic ring that breaks off the cap and stays on the bottle after opening, since that seems to allow a better (tighter) seal.
I've been re-using caps for years, and scavenging caps from soft...