[dev] Question about problem with VANISHED CHANGEDSINCE requests.

Thu Nov 1 14:59:39 UTC 2012

We've discussed this issue before, and I realize it is most likely a  
problem with the dovecot server. I want to verify this before I start  
a discussion on the dovecot@ list though.

The problem is VANISHED queries sometimes seem to return ALL UIDs that  
ever existed in the mailbox. It follows no pattern that I can detect -  
though I had a thought that it might happen if the the email that was  
associated with the particular MODSEQ value being used in the  
CHANGEDSINCE query is no longer present in the mailbox. Anyway, once  
it happens it *always* happens with the given MODSEQ value.

I used to work around it in code by checking if a UID returned was  
below the expected minimum, but this no longer works due to recent  
changes in the imap code - it now hits against the server memory limit  
before I get a chance to check the UIDs.

Anyway, I just want to verify that my error makes, and it is indeed a  
dovecot problem given the following IMAP log:

------------------------------
>> Timestamp: Thu, 01 Nov 2012 10:16:39 -0400
S: * OK [CAPABILITY IMAP4rev1 LITERAL+ LOGIN-REFERRALS ID ENABLE   
XIMAPPROXY] Dovecot ready.
C: [LOGIN Command - username: mike]
S: * OK [XPROXYREUSE] IMAP connection reused by imapproxy
S: 1 OK User logged in
C: 2 CAPABILITY
S: * CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE  
IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND  
UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1  
CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH  
LIST-STATUS
S: 2 OK Capability completed.
C: 3 ENABLE QRESYNC
S: * ENABLED QRESYNC
S: 3 OK Enabled.
C: 4 NAMESPACE
S: * NAMESPACE (("" "/")) NIL NIL
S: 4 OK Namespace completed.
C: 5 STATUS "INBOX" (UIDNEXT UIDVALIDITY HIGHESTMODSEQ)
S: * STATUS "INBOX" (UIDNEXT 145195 UIDVALIDITY 1292457115  
HIGHESTMODSEQ 588041)
S: 5 OK Status completed.
C: 6 EXAMINE "INBOX" (QRESYNC (1292457115 588041  
144330,144317,144179,119945:119946,123483,128044,130389,130457,132128,135833,136202,136302,136317,138503,140100,141909,142608,142745,142866,143161:143163,143174:143175,143180,143188,143191,143196,143271,143274,143281,143303:143304,143308,143319,143334,143338,143342,143376,143401,143552,143638:143639,143707,144070,144308,144932,145133:145135,145070,145073,144984,145001,145179,145192))
S: * FLAGS (\Answered \Flagged \Deleted \Seen \Draft)
S: * OK [PERMANENTFLAGS ()] Read-only mailbox.
S: * 58 EXISTS
S: * 1 RECENT
S: * OK [UNSEEN 58] First unseen.
S: * OK [UIDVALIDITY 1292457115] UIDs valid
S: * OK [UIDNEXT 145195] Predicted next UID
S: * OK [HIGHESTMODSEQ 588041] Highest
S: 6 OK [READ-ONLY] Select completed.
>> Retrieved search results from cache (mailbox: INBOX; id:  
>> a1000e9c41f56e01f5063113aa37d764)
>> CACHE: Retrieved messages (mailbox: INBOX; UIDs:  
>> 119945:119946,123483,128044,130389,130457,132128,135833,136202,136302,136317,138503,140100,141909,142608,142745,142866,143161:143163,143174:143175,143180,143188,143191,143196,143271,143274,143281,143303:143304,143308,143319,143334,143338,143342,143376,143401,143552,143638:143639,143707,144070,144179,144308,144317,144330,144932,144984,145001,145070,145073,145133:145135,145179,145192)
C: 7 UID SEARCH RETURN (ALL COUNT) UID 1:* MODSEQ 587743
S: * ESEARCH (TAG "7") UID ALL 145133:145135,145179,145192,145194  
COUNT 6 MODSEQ 588041
S: 7 OK Search completed (0.000 secs).
>> CACHE: Stored metadata (mailbox: INBOX; Keys: HICsearch)
>> Saved search results to cache (mailbox: INBOX; id:  
>> 0695adbb931620865b3ebdc86b7a023a)
C: 8 UID FETCH 1:* UID (VANISHED CHANGEDSINCE 587742)
S: * VANISHED (EARLIER)  
1:119944,119947:123482,123484:128043,128045:130388,130390:130456,130458:132127,132129:135832,135834:136201,136203:136301,136303:136316,136318:138502,138504:140099,140101:141908,141910:142607,142609:142744,142746:142865,142867:143160,143164:143173,143176:143179,143181:143187,143189:143190,143192:143195,143197:143270,143272:143273,143275:143280,143282:143302,143305:143307,143309:143318,143320:143333,143335:143337,143339:143341,143343:143375,143377:143400,143402:143551,143553:143637,143640:143706,143708:144069,144071:144178,144180:144307,144309:144316,144318:144329,144331:144931,144933:144983,144985:145000,145002:145069,145071:145072,145074:145132,145136:145178,145180:145191,145193
------------------------------

-- 
mike

The Horde Project (www.horde.org)
mrubinsk at horde.org
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 6062 bytes
Desc: S/MIME Cryptographic Signature
URL: <http://lists.horde.org/archives/dev/attachments/20121101/c82c4591/attachment.bin>