You can't pick your family. You're stuck with them. Genetically, that is. Sounds to me like you have given it a fair try. I know if I had to deal with a parent and siblings like you've described I would be hiding and making my phone number unlisted.
I have such a hard time relating to this scenario, though, because I was extremely close to my parents and my sister. And I'm still very close with the one sister I have who is still alive.
I'm so sorry you're having to deal with this. I don't know how you'd feel after the fact if you didn't go. Would it be worse than going and dealing with all the stress that you already know is waiting for you. Only you can answer that. One thing I can do for you, though, is keep you in my prayers. And that I promise to do.