I did some searching around and I don't see any information on how to do this. I'm sure I've seen other people use this feature in their maps before. You hover over an icon on the multiboard and it will displays a custom tooltip similarly to any ability tooltip.