[horde] Problem of slow with server-side sorting

Jose Luis Marin Perez jolumape_al at hotmail.com
Mon Jun 8 14:21:50 UTC 2009


> Date: Fri, 5 Jun 2009 10:02:28 +0200
> From: lst_hoe02 at kwsoft.de
> To: horde at lists.horde.org
> Subject: Re: [horde] Problem of slow with server-side sorting
>
> Zitat von Jose Luis Marin Perez <jolumape_al at hotmail.com>:
>
> >
> >> Date: Thu, 4 Jun 2009 09:27:21 +0200
> >> From: rsalmon at mbpgroup.com
> >> To: jolumape_al at hotmail.com
> >> CC: horde at lists.horde.org
> >> Subject: RE: [horde] Problem of slow with server-side sorting
> >>
> >>
> >> Jose Luis Marin Perez <jolumape_al at hotmail.com> a écrit :
> >>
> >> > Thanks for your answers.
> >> >
> >> > These hardware features:
> >> >
> >> > ML370 G4
> >> > Xeon 3.6 GHz CPU
> >> > 1 GB RAM
> >> > Hard Drive 300GB - Raid 1 - EXT3
> >> SAS or SATA ?
> >> did you disable atime on ext3 (Maildirs disk) ?
> >>
> >> > When accessing one of these accounts capture a sample of the TOP
> >> > command
> >> >
> >> > top - 09:37:51 up 4 days, 15:26, 2 users, load average: 5.07,
> >> > 4.85, 4.79
> >> > Tasks: 146 total, 1 running, 145 sleeping, 0 stopped, 0
> >> > zombie
> >> > Cpu(s): 46.5% us, 19.8% sy, 0.0% ni, 19.8% id, 13.9% wa, 0.0%
> >> > hi, 0.0% si
> >> > Mem: 1034512k total, 1008464k used, 26048k free,
> >> > 55592k buffers
> >> > Swap: 2048276k total, 143232k used, 1905044k free,
> >> > 516016k cached
> >>
> >> You definitely need more RAM! The load is pretty high. What is the
> >> running process?
> >>
> >> > On our server there are about 5000 mail accounts with more than
> >> > 1000 messages per account.
> >> >
> >> > As can enable an option _imp_hook_msglist_format and that benefits
> >> > could give me to solve my problem?
> >>
> >> The fact that we have the hook _imp_hook_msglist_format enabled really
> >> slow down accessing mailboxes (especially if they contains lots of
> >> emails) has IMP reads the content of each email to see if there are
> >> any attachments.
> >>
> >>
> >> Jose, can you reply after the message(instead of before)? It is easier
> >> to keep track of the discussion. thanks.
> >>
> >> Ronan.
> >
> > Dear Ronan,
> >
> > The server has 300GB SCSI RAID 1 - Ext3
> >
> > Ext3 is the default has not changed anything in the configuration,
> > this would help?
> >
> > Based on your experience as it should increase the RAM?
> >
> > This is an example of TOP to see the process:
> >
> > top - 09:46:33 up 5 days, 15:35, 2 users, load average: 10.59, 13.92, 12.80
> > Tasks: 175 total, 2 running, 173 sleeping, 0 stopped, 0 zombie
> > Cpu(s): 36.1% us, 8.9% sy, 0.0% ni, 13.9% id, 41.1% wa, 0.0% hi, 0.0% si
> > Mem: 1034512k total, 1005808k used, 28704k free, 76620k buffers
> > Swap: 2048276k total, 163040k used, 1885236k free, 441280k cached
> >
> > PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
> > 3184 mysql 15 0 886m 55m 2664 S 32.6 5.5 1732:33 mysqld
> > 3760 daemon 16 0 22640 9.9m 4224 S 27.7 1.0 0:01.36 httpd
> > 29351 daemon 16 0 28124 15m 4724 S 11.9 1.5 0:10.13 httpd
> > 30238 daemon 16 0 22992 10m 4488 S 10.9 1.0 0:02.63 httpd
>
> Your MySQL Database is bogged down and you should consider using a PHP
> accelerator. The "wait" percentage is high, this could be a sign of
> overloaded disk I/O. Check what is doing most of I/O. It *may* be
> MySQL so have a look why.
>
> Regards
>
> Andreas
>
> --
> Horde mailing list - Join the hunt: http://horde.org/bounties/#horde
> Frequently Asked Questions: http://horde.org/faq/
> To unsubscribe, mail: horde-unsubscribe at lists.horde.org

Thanks for your response,

I increased the RAM to 2 GB and there is a small increase to improve service.

Based on the commentary of Andreas, I have noticed through IOSTAT (% util) the Disk I / O is high and reaches 100 when using any of these webmail accounts that have more than 1500 messages

avg-cpu:  %user   %nice    %sys %iowait   %idle
          52.87    0.00   20.20   17.96    8.98

Device:    rrqm/s wrqm/s   r/s   w/s  rsec/s  wsec/s    rkB/s    wkB/s avgrq-sz avgqu-sz   await  svctm  %util
cciss/c0d0   2.01 194.97 58.29 34.67 1861.31 1837.19   930.65   918.59    39.78     1.83   19.82   7.95  73.87
cciss/c0d0p1
             0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00
cciss/c0d0p2
             0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00
cciss/c0d0p3
             2.01 194.97 58.29 34.67 1861.31 1837.19   930.65   918.59    39.78     1.83   19.82   7.95  73.87

avg-cpu:  %user   %nice    %sys %iowait   %idle
          17.25    0.00   10.50   39.75   32.50

Device:    rrqm/s wrqm/s   r/s   w/s  rsec/s  wsec/s    rkB/s    wkB/s avgrq-sz avgqu-sz   await  svctm  %util
cciss/c0d0   5.97 160.20 59.70 41.79 1655.72 1615.92   827.86   807.96    32.24     2.30   20.74   8.06  81.79
cciss/c0d0p1
             0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00
cciss/c0d0p2
             0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00
cciss/c0d0p3
             5.97 160.20 59.70 41.79 1655.72 1615.92   827.86   807.96    32.24     2.30   20.74   8.06  81.79

avg-cpu:  %user   %nice    %sys %iowait   %idle
          22.31    0.00    7.77   44.36   25.56

Device:    rrqm/s wrqm/s   r/s   w/s  rsec/s  wsec/s    rkB/s    wkB/s avgrq-sz avgqu-sz   await  svctm  %util
cciss/c0d0  12.56   0.00 102.01  0.00 2641.21    0.00  1320.60     0.00    25.89     2.92   30.45   9.84 100.35
cciss/c0d0p1
             0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00
cciss/c0d0p2
             0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00
cciss/c0d0p3
            12.56   0.00 102.01  0.00 2641.21    0.00  1320.60     0.00    25.89     2.92   30.45   9.84 100.35

avg-cpu:  %user   %nice    %sys %iowait   %idle
          49.00    0.00   16.50   22.25   12.25

Device:    rrqm/s wrqm/s   r/s   w/s  rsec/s  wsec/s    rkB/s    wkB/s avgrq-sz avgqu-sz   await  svctm  %util
cciss/c0d0   7.96   0.00 289.05  0.00 16756.22    0.00  8378.11     0.00    57.97     2.30    8.02   2.85  82.24
cciss/c0d0p1
             0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00
cciss/c0d0p2
             0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00
cciss/c0d0p3
             7.96   0.00 289.05  0.00 16756.22    0.00  8378.11     0.00    57.97     2.30    8.02   2.85  82.24

###############################################

             total       used       free     shared    buffers     cached
Mem:          2026       1989         36          0        143       1214
-/+ buffers/cache:        631       1394
Swap:         2000          0       2000

###############################################


The question is whether there is any special configuration in Horde or Courier-IMAP for not saturating the Disk I / O.

If you increase the RAM can help with anything?

Thanks

Jolumape
_________________________________________________________________
Discover the new Windows Vista
http://search.msn.com/results.aspx?q=windows+vista&mkt=en-US&form=QBRE


More information about the horde mailing list