I've discovered what I believe is weird and unintuitive behaviour. Whenever I disable Private Networking, it enables itself after a while. The interval seems to be like a day or so and it's something on Railway side that enables it.