If you don't want Windows to back up your system files:
1. Open the Control Panel
2. Double-click on system
3. Click the System Restore tab
4. Check "Turn off System Restore on all drives"
5. Hit Apply
6. You may now delete the System Volume Information folder.
Warning! If you turn this off you will not be able to use Windows System Restore to restore your system in case of failure.