You should try updating the Android TV Remote core services if that's not been updated yet. Just head to the play store and update it there if you haven't.
Try some alternatives. Works way better than Google crapware and has much more functionality.
Use phone for controlling TV box. Can also launch apps.
Zank Remote - Remote for Android TV Box
https://play.google.com/store/apps/details?id=zank.remote
Serverless Bluetooth Keyboard & Mouse for PC/Phone
https://play.google.com/store/apps/details?id=io.appground.blek
Serverless Bluetooth Keyboard & Mouse Premium
https://play.google.com/store/apps/details?id=io.appground.blekpremium
Unfortunately nothing, hopefully it won't be too much longer before the Google TV app adds the remote and this one can be laid to rest.