The same way you can extract the textures of the enabled icons. They are just at a different path, relative to the enabled icon texture. A tool like MPQEdit can be used to extract them from the map archive. If a complete listfile is present then the folder/path of the disabled button textures should be pretty clear.