Turns out you can easily setup an Elgato Key Light on Linux by connecting to its default wifi connection, going to http://192.168.62.1:9123/ and plugging in your wifi details. And then pointing Home Assistant at it.