[horde] Can't go to administration configuration

[Angus]

I just installed horde and following the configuring step from Horde
document (http://www.horde.org/apps/horde/docs/INSTALL#configuring-horde).
I have finished the step 2 change the conf.php.dist to conf.php. Now, I can
go the my horde page without password, but I can't go to the Administration
-> Configuration and syslog output "[horde] Permission denied.". However, I
have changed owner of my horde files and folders to apache:apache.

So what's wrong on this?