I don't think the vanilla firmware comes with any kind of default button testing application last I remember seeing. Not sure if custom firmwares do either.
A band-aid method of testing the buttons however would be to switch over to the RetroArch side (press Select -> Start Retroarch) and then map the buttons for the controller.