I think you might be able to just remove the drivers for it, but Windows may want to keep re-installing them and thwarting your attempt.
I wouldn't just unplug the power while leaving it in the PCI slot though - either leave it all plugged in, or remove it entirely. It ~shouldn't~ hurt it and...