Is it safe to delete any files from System32?

There is a pesky driver, which is prohibiting me from using my gamepad. I can't uninstall it through device manager, but device manager does tell me what the file is for it. As far as I know, this driver is not used by any of my installed programs, so is it safe to delete it, or will it cause problems?