For now, I noticed enabling "don't cache pages for logged in users" in the page cache works, so the problem is definitely the page cache.
I want pages cached for login users though, as they will probably be a significant portion of my visitors and contribute greatly to my site speed statistics!
