What is really the output of a ReactJS or any frontend library?

Front-end libraries are generating static files and not needing to be run through nodejs or a web server.

Static files can be hosted easily. Because all you really have is just have a bunch html, CSS, JS files and other static assets.

Unless you need server rendering – Something like NextJS changes the game.