Further investigation informs me that most people will never have this issue as usbgard is not normally installed by default on Ubuntu. I’m guessing I installed it by accident due to an apt install --with-suggests ... and it pulled in the package and created rules for usb devices already installed.
If you have usbguard and it is causing you issues, then I recommend just removing the package unless you need the extra security it provides.