From my understanding, calcium carbonate should rarely, if ever, be used. Generally you want to neutralise alkalinity, especially for lighter beer styles.
If your water is low in calcium content then an addition of calcium sulphate or calcium chloride would be more beneficial. These will help...