Maybe via python script or something? Or editing the installed blender code.
I didn't found conclusive answers to hide only this one button. Only how to hide all of them. But it should be possible.
Also please don't ask why. Or propose a workaround solution. I have plenty of the but I would love to know this and learn a little deeper into blender.