I have a tivo 4k stream connected to a bluetooth speaker for audio. If I press the volume button once on the tivo remote then the slider volume goes to max and the volume level on the speaker itself shows at max level.
Additionally, if I unmute the device the volume level goes to max and does not return to the prior volume level.
What BT speaker are you using? What version is your Android TV? Have you tried updating your device?