If he is happy there, then you are doing the right thing.
I know you'll miss him but being able to go outside and play and go for walks will probably be good for him. Maybe you could get a nice lap kitty?
They are easier to take care of because they are mostly self efficient.