white silicon part first, then the button... maybe...

As with anything worth doing, try putting it in from behind. Hard part first.

Try taking the remote apart, just divide it with a credit card or something

Looks like you just took off the front of the button.