[dev] I/O hammering

Egan egan@sevenkings.net
Tue, 05 Jun 2001 10:35:10 -0400
Next message: [dev] I/O hammering
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
On Wed, 30 May 2001 14:41:22 -0400, Chuck Hagenbuch <chuck@horde.org>
wrote:

>I've done some work to see if we can get any better with the current PHP 
>functions. I'm attaching a modified mailbox.php; it'd be very useful if any of 
>you can trace it to see if it does any better.
>
>With it, you can control whether or not IMP fetches the MIME structure through 
>$conf['mailbox']['show_attachments']. You'll need to set this to avoid 
>errors... For the trace, I'd like to see this off;

I turned that off.

The ENVELOPE information, for the whole screenful, is fetched in a
single FETCH request, so that is an improvement.  But prior to that,
there is still some looping construct that is requesting UID
information:


    UID FETCH 5857 UID
    1 FETCH (UID 5857)
    OK UID FETCH COMPLETED


    UID FETCH 5858 UID
    1 FETCH (UID 5858)
    OK UID FETCH COMPLETED


    UID FETCH 5859 UID
    1 FETCH (UID 5859)
    OK UID FETCH COMPLETED


... and so on for the full list of 20 messages.


Also, it seems that the "FETCH 1,2:21 (ENVELOPE," could omit unneeded
information.  The "BODY.PEEK[HEADER.FIELDS" included in the request is
returning PATH, MESSAGE-ID, NEWSGROUPS, FOLLOWUP-TO, and REFERENCES.
I don't see where any of those are used for building the message list.
It appears that dropping the BODY.PEEK from the request to omit those
fields from the return data would reduce the data volume of that one
request maybe 30-40%.

This change to mailbox.php is an improvement, but more is needed.


Egan




>From chuck@horde.org Date: Tue,  5 Jun 2001 10:56:46 -0400
Return-Path: <chuck@horde.org>
Mailing-List: contact dev-help@lists.horde.org; run by ezmlm
Delivered-To: mailing list dev@lists.horde.org
Received: (qmail 76128 invoked from network); 5 Jun 2001 14:58:28 -0000
Received: from 208-59-250-206.c3-0.smr-ubr1.sbo-smr.ma.cable.rcn.com (HELO marina.horde.org) (208.59.250.206)
  by horde.org with SMTP; 5 Jun 2001 14:58:28 -0000
Received: by marina.horde.org (Postfix, from userid 33)
	id 84AEC39F6; Tue,  5 Jun 2001 10:56:46 -0400 (EDT)
Received: from 206.243.191.252 ( [206.243.191.252])
	as user chuck@localhost by marina.horde.org with HTTP;
	Tue,  5 Jun 2001 10:56:46 -0400
Message-ID: <991753006.3b1cf32e67db2@marina.horde.org>
Date: Tue,  5 Jun 2001 10:56:46 -0400
From: Chuck Hagenbuch <chuck@horde.org>
To: dev@lists.horde.org
References: <33q4htkejqt3801e5o98q1adslh9dh5cns@4ax.com> <991068607.3b1281bf313b2@marina.horde.org> <1sn5htck83778345rplp3e8fqsdqvdeiis@4ax.com> <89a7ht4cq9cheq0dgjvv6pbgsn2dff413v@4ax.com> <014c01c0e84a$08d3b510$05eca8c0@shock> <d1f7ht48l886jho003t551rkaflj38p7av@4ax.com> <002101c0e859$d91836b0$c2ec87d4@shock> <oal7ht46t20rb6brmhp2olu7la06cd2jv1@4ax.com> <004a01c0e875$1c42a040$c2ec87d4@shock> <2b98ht0vosfikvi1p4blv8q1fbgagnnf8c@4ax.com> <991248082.3b153ed2d75b0@marina.horde.org> <1qpphtsoroa1o5cjhvspahan7apdt5eujc@4ax.com>
In-Reply-To: <1qpphtsoroa1o5cjhvspahan7apdt5eujc@4ax.com>
MIME-Version: 1.0
Content-Type: text/plain
Content-Transfer-Encoding: 8bit
User-Agent: Internet Messaging Program (IMP) 2.3.7-cvs
Subject: Re: [dev] I/O hammering

Quoting Egan <egan@sevenkings.net>:

> The ENVELOPE information, for the whole screenful, is fetched in a
> single FETCH request, so that is an improvement.  But prior to that,
> there is still some looping construct that is requesting UID
> information:
> 
> 
>     UID FETCH 5857 UID
>     1 FETCH (UID 5857)
>     OK UID FETCH COMPLETED

This is most likely caused by the mail_uid_sequence() call in PHP's 
imap_fetch_overview. I don't know if there's a way around that with c-client.

> Also, it seems that the "FETCH 1,2:21 (ENVELOPE," could omit unneeded
> information.  The "BODY.PEEK[HEADER.FIELDS" included in the request is
> returning PATH, MESSAGE-ID, NEWSGROUPS, FOLLOWUP-TO, and REFERENCES.
> I don't see where any of those are used for building the message list.
> It appears that dropping the BODY.PEEK from the request to omit those
> fields from the return data would reduce the data volume of that one
> request maybe 30-40%.

We can't do that level of tweaking without modifying c-client.

-chuck

--
Charles Hagenbuch, <chuck@horde.org>
Black and white and grey, all the shades of truth.


>From chuck@horde.org Date: Wed,  6 Jun 2001 00:03:47 -0400
Return-Path: <chuck@horde.org>
Mailing-List: contact dev-help@lists.horde.org; run by ezmlm
Delivered-To: mailing list dev@lists.horde.org
Received: (qmail 24901 invoked from network); 6 Jun 2001 04:05:29 -0000
Received: from 208-59-250-206.c3-0.smr-ubr1.sbo-smr.ma.cable.rcn.com (HELO marina.horde.org) (208.59.250.206)
  by horde.org with SMTP; 6 Jun 2001 04:05:29 -0000
Received: by marina.horde.org (Postfix, from userid 33)
	id E297439EE; Wed,  6 Jun 2001 00:03:47 -0400 (EDT)
Received: from 192.168.0.109 ( [192.168.0.109])
	as user chuck@localhost by marina.horde.org with HTTP;
	Wed,  6 Jun 2001 00:03:47 -0400
Message-ID: <991800227.3b1daba3ca3ff@marina.horde.org>
Date: Wed,  6 Jun 2001 00:03:47 -0400
From: Chuck Hagenbuch <chuck@horde.org>
To: dev@lists.horde.org
References: <991320132.3b16584423533@linux.wg.de>
In-Reply-To: <991320132.3b16584423533@linux.wg.de>
MIME-Version: 1.0
Content-Type: text/plain
Content-Transfer-Encoding: 8bit
User-Agent: Internet Messaging Program (IMP) 2.3.7-cvs
Subject: Re: [dev] Horde portal

Quoting Jan Schneider <janmailing@gmx.de>:

> I'm starting to implement a "portal" for horde, that is after login to horde 
> you get a summary of information from you horde apps. E.g. new emails from 
> imp, todays appointments from kronolith and open tasks from nag. Just 
> imagine "Outlook Today".
> 
> I thought I would manage to implement this without indepth knowhow of the 
> horde framework with a little bit of cut and paste and some general php
> skills. But I was wrong.

Take a look at what I've committed the last day or so to list Nag tasks, etc. 
It should be done this way - through the registry, abstracted, etc - Horde 
should _never_ make an explicit reference to an individual application.

I'll take a look at a messages summary, also, but I'm curious what you think of 
what's there, and if you can follow it to create your own.

-chuck

--
Charles Hagenbuch, <chuck@horde.org>
Black and white and grey, all the shades of truth.


>From chuck@horde.org Date: Wed,  6 Jun 2001 00:31:20 -0400
Return-Path: <chuck@horde.org>
Mailing-List: contact dev-help@lists.horde.org; run by ezmlm
Delivered-To: mailing list dev@lists.horde.org
Received: (qmail 27044 invoked from network); 6 Jun 2001 04:33:02 -0000
Received: from 208-59-250-206.c3-0.smr-ubr1.sbo-smr.ma.cable.rcn.com (HELO marina.horde.org) (208.59.250.206)
  by horde.org with SMTP; 6 Jun 2001 04:33:02 -0000
Received: by marina.horde.org (Postfix, from userid 33)
	id 8F6B839EE; Wed,  6 Jun 2001 00:31:20 -0400 (EDT)
Received: from 192.168.0.109 ( [192.168.0.109])
	as user chuck@localhost by marina.horde.org with HTTP;
	Wed,  6 Jun 2001 00:31:20 -0400
Message-ID: <991801880.3b1db21856b6b@marina.horde.org>
Date: Wed,  6 Jun 2001 00:31:20 -0400
From: Chuck Hagenbuch <chuck@horde.org>
To: dev@lists.horde.org
References: <991453766.3b18624682a4e@vincent.techsoft.com.hk>
In-Reply-To: <991453766.3b18624682a4e@vincent.techsoft.com.hk>
MIME-Version: 1.0
Content-Type: text/plain
Content-Transfer-Encoding: 8bit
User-Agent: Internet Messaging Program (IMP) 2.3.7-cvs
Subject: Re: [dev] can't get translate work

Quoting maillist <maillist@beunion.net>:

> I tried to use fr to test it our first, the problem is I can't get the
> translation at all.

When you set it in IMP, in addition to the other tests? Do any other localized 
apps work? Do you have latest cvs of IMP/Horde?

-chuck

--
Charles Hagenbuch, <chuck@horde.org>
Black and white and grey, all the shades of truth.
Next message: [dev] I/O hammering
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]