What are your settings for BrowserCache HTML expiration time? The plugin checks if file is older than current time minus 5 times the expiration time before it deletes the .old files during the garbage collection run.
Also what value do you have under garbage collection interval on Page Cache settings page?
Do you have any issues with scheduled posts since both that and the garbage collection relies on wp-cron?