We needed to build challenges utilising generative AI and language models for a Capture the Flag competition for a conference happening on a cruise ship sailing in international waters called Disarray. So we needed something fully local and self-hosted. This talk will describe what we learned on hosting this kind of a solution using GenAI locally that we’ve since taken to Disobey and Easterhegg. I will present a setup you can easily rebuild if you want to play with local AI, actually on your own hardware and not spending money on hyperscalers. I will also share a link for you to play with what we built.