[horde] Problem of slow with server-side sorting

Jose Luis Marin Perez jolumape_al at hotmail.com
Fri Jun 5 16:46:31 UTC 2009


> Date: Fri, 5 Jun 2009 10:02:28 +0200
> From: lst_hoe02 at kwsoft.de
> To: horde at lists.horde.org
> Subject: Re: [horde] Problem of slow with server-side sorting
> 
> Zitat von Jose Luis Marin Perez <jolumape_al at hotmail.com>:
> 
> >
> >> Date: Thu, 4 Jun 2009 09:27:21 +0200
> >> From: rsalmon at mbpgroup.com
> >> To: jolumape_al at hotmail.com
> >> CC: horde at lists.horde.org
> >> Subject: RE: [horde] Problem of slow with server-side sorting
> >>
> >>
> >> Jose Luis Marin Perez <jolumape_al at hotmail.com> a écrit :
> >>
> >> > Thanks for your answers.
> >> >
> >> > These hardware features:
> >> >
> >> > ML370 G4
> >> > Xeon 3.6 GHz CPU
> >> > 1 GB RAM
> >> > Hard Drive 300GB - Raid 1 - EXT3
> >> SAS or SATA ?
> >> did you disable atime on ext3 (Maildirs disk) ?
> >>
> >> > When accessing one of these accounts capture a sample of the TOP
> >> > command
> >> >
> >> > top - 09:37:51 up 4 days, 15:26,  2 users,  load average: 5.07,
> >> > 4.85, 4.79
> >> > Tasks: 146 total,   1 running, 145 sleeping,   0 stopped,   0
> >> > zombie
> >> > Cpu(s): 46.5% us, 19.8% sy,  0.0% ni, 19.8% id, 13.9% wa,  0.0%
> >> > hi,  0.0% si
> >> > Mem:   1034512k total,  1008464k used,    26048k free,
> >> > 55592k buffers
> >> > Swap:  2048276k total,   143232k used,  1905044k free,
> >> > 516016k cached
> >>
> >> You definitely need more RAM! The load is pretty high. What is the
> >> running process?
> >>
> >> > On our server there are about 5000 mail accounts with more than
> >> > 1000 messages per account.
> >> >
> >> > As can enable an option _imp_hook_msglist_format and that benefits
> >> > could give me to solve my problem?
> >>
> >> The fact that we have the hook _imp_hook_msglist_format enabled really
> >> slow down accessing mailboxes (especially if they contains lots of
> >> emails) has IMP reads the content of each email to see if there are
> >> any attachments.
> >>
> >>
> >> Jose, can you reply after the message(instead of before)? It is easier
> >> to keep track of the discussion. thanks.
> >>
> >> Ronan.
> >
> > Dear Ronan,
> >
> >  The server has 300GB SCSI RAID 1 - Ext3
> >
> >  Ext3 is the default has not changed anything in the configuration,  
> > this would help?
> >
> >  Based on your experience as it should increase the RAM?
> >
> >  This is an example of TOP to see the process:
> >
> > top - 09:46:33 up 5 days, 15:35,  2 users,  load average: 10.59, 13.92, 12.80
> > Tasks: 175 total,   2 running, 173 sleeping,   0 stopped,   0 zombie
> > Cpu(s): 36.1% us,  8.9% sy,  0.0% ni, 13.9% id, 41.1% wa,  0.0% hi,  0.0% si
> > Mem:   1034512k total,  1005808k used,    28704k free,    76620k buffers
> > Swap:  2048276k total,   163040k used,  1885236k free,   441280k cached
> >
> >   PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
> >  3184 mysql     15   0  886m  55m 2664 S 32.6  5.5   1732:33 mysqld
> >  3760 daemon    16   0 22640 9.9m 4224 S 27.7  1.0   0:01.36 httpd
> > 29351 daemon    16   0 28124  15m 4724 S 11.9  1.5   0:10.13 httpd
> > 30238 daemon    16   0 22992  10m 4488 S 10.9  1.0   0:02.63 httpd
> 
> Your MySQL Database is bogged down and you should consider using a PHP  
> accelerator. The "wait" percentage is high, this could be a sign of  
> overloaded disk I/O. Check what is doing most of I/O. It *may* be  
> MySQL so have a look why.
> 
> Regards
> 
> Andreas
> 
> --
> Horde mailing list - Join the hunt: http://horde.org/bounties/#horde
> Frequently Asked Questions: http://horde.org/faq/
> To unsubscribe, mail: horde-unsubscribe at lists.horde.org

Thanks for your response, 



I increased the RAM to 2 GB and there is a small increase to improve service. 




Based on the commentary of Andreas, I have noticed through IOSTAT (%
util) the Disk I / O is high and reaches 100 when using any of these
webmail accounts that have more than 1500 messages 



avg-cpu:  %user   %nice    %sys %iowait   %idle

          52.87    0.00   20.20   17.96    8.98



Device:    rrqm/s wrqm/s   r/s   w/s  rsec/s  wsec/s    rkB/s    wkB/s avgrq-sz avgqu-sz   await  svctm  %util

cciss/c0d0   2.01 194.97 58.29 34.67 1861.31 1837.19   930.65   918.59    39.78     1.83   19.82   7.95  73.87

cciss/c0d0p1

             0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00

cciss/c0d0p2

             0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00

cciss/c0d0p3

             2.01 194.97 58.29 34.67 1861.31 1837.19   930.65   918.59    39.78     1.83   19.82   7.95  73.87



avg-cpu:  %user   %nice    %sys %iowait   %idle

          17.25    0.00   10.50   39.75   32.50



Device:    rrqm/s wrqm/s   r/s   w/s  rsec/s  wsec/s    rkB/s    wkB/s avgrq-sz avgqu-sz   await  svctm  %util

cciss/c0d0   5.97 160.20 59.70 41.79 1655.72 1615.92   827.86   807.96    32.24     2.30   20.74   8.06  81.79

cciss/c0d0p1

             0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00

cciss/c0d0p2

             0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00

cciss/c0d0p3

             5.97 160.20 59.70 41.79 1655.72 1615.92   827.86   807.96    32.24     2.30   20.74   8.06  81.79



avg-cpu:  %user   %nice    %sys %iowait   %idle

          22.31    0.00    7.77   44.36   25.56



Device:    rrqm/s wrqm/s   r/s   w/s  rsec/s  wsec/s    rkB/s    wkB/s avgrq-sz avgqu-sz   await  svctm  %util

cciss/c0d0  12.56   0.00 102.01  0.00 2641.21    0.00  1320.60     0.00    25.89     2.92   30.45   9.84 100.35

cciss/c0d0p1

             0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00

cciss/c0d0p2

             0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00

cciss/c0d0p3

            12.56   0.00 102.01  0.00 2641.21    0.00  1320.60     0.00    25.89     2.92   30.45   9.84 100.35



avg-cpu:  %user   %nice    %sys %iowait   %idle

          49.00    0.00   16.50   22.25   12.25



Device:    rrqm/s wrqm/s   r/s   w/s  rsec/s  wsec/s    rkB/s    wkB/s avgrq-sz avgqu-sz   await  svctm  %util

cciss/c0d0   7.96   0.00 289.05  0.00 16756.22    0.00  8378.11     0.00    57.97     2.30    8.02   2.85  82.24

cciss/c0d0p1

             0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00

cciss/c0d0p2

             0.00   0.00  0.00  0.00    0.00    0.00     0.00     0.00     0.00     0.00    0.00   0.00   0.00

cciss/c0d0p3

             7.96   0.00 289.05  0.00 16756.22    0.00  8378.11     0.00    57.97     2.30    8.02   2.85  82.24

###############################################

             total       used       free     shared    buffers     cached
Mem:          2026       1989         36          0        143       1214
-/+ buffers/cache:        631       1394
Swap:         2000          0       2000

###############################################




The question is whether there is any special configuration in Horde or Courier-IMAP for not saturating the Disk I / O.

If you increase the RAM can help with anything?



Thanks



Jolumape

_________________________________________________________________
Discover the new Windows Vista
http://search.msn.com/results.aspx?q=windows+vista&mkt=en-US&form=QBRE


More information about the horde mailing list