It seems a bit silly that the premier wordpress performance plugin doesn't have a clear way to share config across a multi-server environment.
Perhaps I'll change the plugin code itself to use my mounted s3 bucket location to store the config directly.