did you try a different mouse- to see if there was the same problem with it?

If yours is optical it would have a red light in the bottom of it.
if it is a older style with a roller ball it would have a little ball with some metal contacts inside.

I've never opened up any of my optical ones, but the old roller balls used to get lots of junk inside. plus the metal contact parts can get gunked up too. you need something to clean those like rubbing alcohol on a Q tip or some other cleaner, whatever works and is not oily or greasy.

I don't know about the remote part, I do keep all that turned off.