Based on their documentation, it sounds like you could try adding the Material Icons font import to the top of your custom tile:
<link href="https://fonts.googleapis.com/icon?family=Material+Icons"
rel="stylesheet">
For example, the Hubitat HTML Attribute custom tile could be modified like so:
