Replacement parts for the advantage are hard to come by. You might try glue or some sort of silicone sealant.
Yeah, I was trying to avoid gluing it and I figured parts were hard to come by but an awesome dude on Nintendo Age had some spare parts so he sold me a few pads!