Thanks, that's very helpful!
As I suspected, you're using virt-manager, and when I tried that route, it did work immediately as you said. I was coming from using kvm directly, and there seems to be a difference somewhere, most likely just some settings. Maybe I'll figure that out later, but...