Currently v2 and v5 versions of Linqpad do not start in Server Core with a fatal COM exception.

If this COM component it's requesting is not critical, perhaps it could be possible to ignore the error or start in feature-limited mode, thus making Linqpad a useful tool for on-the-box troubleshooting/scripting on Server Core servers.