I deactivated WP Fast Cache and the problem still occurred. Looked in .htaccess, and removed all the code that they put in, similar wat WP Total Cache inserted there also.
Things are back to normal now, without caching. Something in the .htaccess file from both cache solutions is breaking the functionality.
I don't understand how being logged in changes what happens in the .htaccess file?