Most people who bring up low Vit D levels, don't need supplements of calcium anymore. The improved Vit D levels greatly increase calcium absorption from food.

Calcium should also be balanced with a good magnesium source, either food, or a good supplement form (not oxide type).

It is believed by some that low magnesium where people only take calcium may lead to spurring of the bones at the joints.
No proof of this but I've seen it mentioned over the years in some papers etc.

Anyone who gets calcium stones in the kidney should only use the citrate form (Citracal) if their doctor approves of calcium supplements. Calcium oxalate stones also seem to respond to
B6 pyridoxine supplements.

I'd get Vit D testing...if I were you so you will be better able to
decide whether you need calcium or not.

edit to add: If you use acid lowering drugs every day, like Nexium etc, or Zantac etc, you will interfere with absorption of both calcium and magnesium. So therefore, that situation has to be addressed by your doctor as well.