No, you'd just need to remove the HID class drivers, for example. So disallow HID_DEVICE, HID_DEVICE_SYSTEM_MOUSE and HID_DEVICE_SYSTEM_KEYBOARD. This would, if I'm following Coleman's link right, ...
The Linux USB input subsystem is a single, harmonized way to manage all input devices. This is a relatively new approach for Linux, with the system being partly incorporated in kernel version 2.4 and ...