On two separate Windows 7 machines, one with Ultimate and one with Home Premium, I ran into the same issue when trying to update LibreOffice 4 to the latest version, 126.96.36.199.
For some reason, there is a folder nested within the LibreOffice 4 directory called program, and this folder is a bitch to do anything with. The reason I found issue with it to begin with is because the installer for LibreOffice 4 kept returning a 1303 permissions error when copying files for the installation. On my first machine, I simply restarted into Ubuntu (the machine is dual-booted) and deleted the LibreOffice 4 directory from the Windows partition using Nautilus. However, on my PC with Home Premium, which isn’t dual-booted, I decided to see if there was a way for me to remedy the issue from within Windows itself. After doing every step I could learn of to either force-delete the file or change permissions, including through CLI with an elevated command prompt, I found that nothing tried within Windows itself would work. In the end, I was still forced to use a linux boot to fix my issue, and I did that using a LiveUSB.
So, if you’re facing the same issue I did, you can take the same step that I did. If you know of a sure-fire solution that can be executed from within Windows, shared knowledge is appreciated.