I don't know about your situation but I do agree with a lot of things that have been said. Boundaries are important. Setting them and keeping them.

Glad you have a counselor. It seems like you need to talk to him more about this and how you can be strong to set boundaries. The other question I would have is your ex's behavior--it borders on abusive from what I've just read. Abuse is about control and he's trying to control and manipulate you. So is this an abusive relationship or one where he just can't let go and truly doesn't know what he wants, a product of confusion rather than abusive behavior? Only you and your counselor can determine that as you know your ex. But if it IS abusive, then by all means seek the advice of a woman's shelter on how best to proceed--for your safety and your child's.

Hang in there. Continue to be strong. This situation is tough and it's no wonder that Olivia is clingy. Divorce is rough on everyone.