I completely removed W3TC because it was giving me all kinds of problems.
I'm using the bilingual site, which means I have two WP installs. One running at the base URL the other at /english/. Both where running W3TC.
Could running W3TC on one domain have been causing my problems? (problems like: 500 errors, blank pages, wrong language menu on english site etc.)