There is a possibility that it will be taken from your backpay should you be approved by disability. I don't think so though. I think you are good. I do know someone who was in your exact situation and did not have to pay it back.
I wish you the very best with your claim! Remember...60% or more get denied at the 1st stage, hang in there..I was approved at the ALJ level...I am in a state where you do not have to do reconsideration.

Take care!!!!!!!!