I'm in therapy right now with ADHD. I think as adults you are not only dealing with the ADHD itself, but also all of the difficulties it has caused you over the years have built up and your self-esteem suffers from that. You learn to expect failure when you've always had trouble finishing anything or have constantly dealt with messing up.