I keep having to remove and replace the batteries in my remote.

Using the stock remote that ships with the new Chromecast with Google TV, and while on the first day it was totally fine, few days later the remote keeps losing its connection with the chromecast.

So far, the quick fix has been removing the batteries for a moment and putting them back in, but that only works temporarily.

Has anyone found a lasting fix for this? Or is everyone just pairing third party remotes? If so, recommendations?