I did not go to college, so I can't answer the real question you seek an answer to, but I think only you would really be able to answer that question for yourself.

The reason I came in to post is you said something in your post that leads me to believe you already in your heart you know the correct answer for yourself.

You said you did not come from the best family, and in fact it couldn't have been a worse family. But then you seem to be taking that same family's words to heart. It seems if they are not people you respect, why would you give their advice any weight?

I know it's hard when you have people in your life that don't support your dreams or goals, and even actively work to tear them down so you will be as miserable as they are in life. My advice is, only you can hold yourself back. Only you can let those negative words eat at you until they become a self-fulfilling prophecy. And then only you can rise above the negative and reach for your goals despite the objections and nay-sayers. It is up to you to find worth in your education. Even if you never did anything with your education, would you be proud you accomplished going to college on your own?

If your body is giving out, but your mind still functions, why not work harder on the parts that can improve? Just my two cents... I wish you the best at overcoming the negative influences in your life and achieving your goals on your own terms!