You can make a custom component for the label component to set the icons and text independently.
You put a link and inside it a custom component label made according to this instruction. It is possible to change almost everything if you split icon from the label. Add more properties if you need them.
Not sure how it will work with SVG. You need to test it.
