That makes a lot of sense. If you use some client-side routing (e.g. Next.js), you might be fine, because the page does not reload during navigation. But if you don't, every HTML page will contain all the SVGs increasing the HTML size unnecessarily.
P.S. I actually went ahead and changed the implementation to a separate file on my website after I saw your comment :D