This is expected behavior. When you add a label, it adds an aria-label to the SVG icon, which helps identify the icon for screen readers. See the screenshot below.
If you want to add a label next to the icon. I recommend first adding a Row block. Then add and Icon and a Paragraph block to the Row. You can then adjust the styling to suit your needs.
