[horde] [sync] ActiveSync attachments not downloading, disappearing on devices

[Thomas Bühlmann]

Am 26.11.2014 17:51, schrieb Andreas Schneider:
>  ----- Nachricht von Volker Then <horde40 at volkerthen.com> ---------
>   Datum: Wed, 26 Nov 2014 17:26:27 +0100
>     Von: Volker Then <horde40 at volkerthen.com>
> Betreff: Re: [sync] ActiveSync attachments not downloading,
> disappearing on
> devices
>      An: sync at lists.horde.org
>
>> Zitat von Michael J Rubinsky <mrubinsk at horde.org>:
>>
>>> Quoting Volker Then <horde40 at volkerthen.com>:
>>>
>>>> Zitat von Michael J Rubinsky <mrubinsk at horde.org>:
>>>>
>>>>> Quoting Volker Then <horde40 at volkerthen.com>:
>>>>>
>>>>>> Zitat von Michael J Rubinsky <mrubinsk at horde.org>:
>>>>>>
>>>>>>> Quoting Volker Then <horde40 at volkerthen.com>:
>>>>>>>
>>>>>>>> Zitat von Volker Then <horde40 at volkerthen.com>:
>>>>>>>>
>>>>>>>>> Zitat von Michael J Rubinsky <mrubinsk at horde.org>:
>>>>>>>>>
>>>>>>>>>> Quoting Volker Then <horde40 at volkerthen.com>:
>>>>>>>>>>
>>>>>>>>>>> Zitat von Michael J Rubinsky <mrubinsk at horde.org>:
>>>>>>>>>>>
>>>>>>>>>>>> Quoting Michael J Rubinsky <mrubinsk at horde.org>:
>>>>>>>>>>>>
>>>>>>>>>>>>> Quoting Michael J Rubinsky <mrubinsk at horde.org>:
>>>>>>>>>>>>>
>>>>>>>>>>>>>> Quoting Volker Then <horde40 at volkerthen.com>:
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Dear list,
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> since a few days there is a problem with ActiveSync on
>>>>>>>>>>>>>>> certain devices. Some of my users report the following
>>>>>>>>>>>>>>> issues:
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> - Outlook 15: Most attachments (jpgs, pdfs) are not getting
>>>>>>>>>>>>>>> downloaded. Some get downloaded up to 50%, some others
>>>>>>>>>>>>>>> aren't visible at all.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> - iOS devices: After tapping on the attachment, it gets
>>>>>>>>>>>>>>> downloaded and then it's visible for a few milliseconds
>>>>>>>>>>>>>>> until it disappears totally.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> I keep the horde pear packages up-to-date on an weekly
>>>>>>>>>>>>>>> basis. Recently there was an update of the ActiveSync
>>>>>>>>>>>>>>> package. Could this be the problem?
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> In the logfiles (debug and activesync) I see nothing
> unusual.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> The horde server is running on a Debian squeeze machine,
>>>>>>>>>>>>>>> PHP 5.3.3-7+squeeze22.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Thanks in advance for any help,
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> *sigh*
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> It seems that actually correctly performing MIME truncation
>>>>>>>>>>>>>> actually breaks these clients. I give up.
>>>>>>>>>>>>>
>>>>>>>>>>>>> This was actually my fault.
>>>>>>>>>>>>>
>>>>>>>>>>>>> Should be fixed in Git (fixes in both Core and ActiveSync).
>>>>>>>>>>>>> Will push a new release after I run/test for a bit more in my
>>>>>>>>>>>>> personal production.
>>>>>>>>>>>>
>>>>>>>>>>>> I pushed the releases for this, as everything seems good.
>>>>>>>>>>>>
>>>>>>>>>>>> There is some issue with emails originally containing only
>>>>>>>>>>>> plaintext leaking mime boundry text that I'm still looking
>>>>>>>>>>>> into, but I think that's due to some recent changes in
>>>>>>>>>>>> Horde_Mime since they still occur when the ActiveSync changes
>>>>>>>>>>>> are backed out.
>>>>>>>>>>>
>>>>>>>>>>> Something is wrong with the dependencies:
>>>>>>>>>>>
>>>>>>>>>>> horde/Horde_Core requires package "horde/Horde_Mime" (version
>>>>>>>>>>> >= 2.5.0, version <= 3.0.0alpha1, excluded versions:
>>>>>>>>>>> 3.0.0alpha1), installed version is 2.4.5
>>>>>>>>>>
>>>>>>>>>> I didn't realize Horde_Mime's version requirement was bumped.
>>>>>>>>>> Pushing a Horde_Mime now.
>>>>>>>>>
>>>>>>>>> Hi Mike,
>>>>>>>>>
>>>>>>>>> After the recent updates with fixed horde_smtp, there is still
>>>>>>>>> the problem with ActiveSync on iOS (empty message bodies, not
>>>>>>>>> attachments being displayed) and Outlook. In the sync log I see
>>>>>>>>> several error messages (Outlook):
>>>>>>>>>
>>>>>>>>> 2014-11-23T20:30:58+01:00 ERR: [19950] Attempting to add a
>>>>>>>>> collection
>>>>>>>>>              to the sync cache while requiring a synckey,
> but no
>>>>>>>>>              synckey could be found. Most likely a client
> error in
>>>>>>>>>              requesting a collection during PING before it
> has
>>>>>>>>> issued a
>>>>>>>>>              SYNC.
>>>>>>>>>
>>>>>>>>> 2014-11-23T20:30:58+01:00 ERR: [21584]
>>>>>>>>> Horde_ActiveSync_Collections::getBackendIdForFolderUid failed
>>>>>>>>> because folder was not found in cache.
>>>>>>>>>
>>>>>>>>> Volker
>>>>>>>>
>>>>>>>> After today's ActiveSync update at least iOS is syncing. But I
>>>>>>>> have still the issue with my Outlook clients (see above).
>>>>>>>
>>>>>>> You mean with blank email bodies? Can you provide a sync log?  I
>>>>>>> wasn't seeing that when I tested before release last night.
>>>>>>
>>>>>> The issue with the blank email bodies was on the iOS client. This
>>>>>> seems to be fixed by now. Outlook stopped syncing at all after the
>>>>>> recent updates. I sent you the log a few minutes ago.
>>>>>
>>>>> It looks like the server side folder cache was removed or corrupted,
>>>>> but OL is not responding the the '12' status code that tells it to
>>>>> re-initialize the state. Try removing and recreating the account.
>>>>
>>>> Yes, the cache files were removed after I got the message "Cache
>>>> version changed" after the recent updates. How would I remove and
>>>> recreate a production account? The user's account is working on his
>>>> iOS client. Cache files are stored in the local file system, the user
>>>> backend is ldap.
>>>
>>> Sorry, I wasn't clear enough. I'm talking about the sync cache and/or
>>> client state. These are not related to any other Horde cache. They are
>>> stored in SQL.
>>>
>>> Anyway, if removing the client from Horde's activesync administration
>>> screen doesn't force OL to reset itself, you can either remove OL's
>>> local cache file and/or just delete and recreate the account in OL.
>>
>> Again some tests with Outlook and ActiveSync. It's still not working
>> like prior to ActiveSync 2.20.*. The full collection never gets synced,
>> Outlook retrieves identical ServerEntryIDs multiple times, but in the
>> client no email appears. When I sync only the last month, some utems got
>> synced, before the syncing process stops. The Log says, that it found
>> loads of changes, but they don't get synced. Any progress here? OL sync
>> was working almost perfectly in the last weeks. Anyone else witnessing
>> this? (in case you have an up-to-date horde installation)
>> Volker
>
> hi i have the same issue ... updated today morning ... endless outlook
> 2013
> sync
> in the apache.log i found 1000x :
>
> mod_fcgid: stderr: PHP Fatal error:  Call to a member function toString()
> on a non-object in /usr/local/share/pear/Horde/Mime/Part.php on line 1282
>  Mit freundlichen Grüssen
>
> Andreas Schneider
>
>
Hello all.

I had the same issue with one of my users using outlook 13 with
activsync. ( Horde_ActiveSync v2.20.4)
I cleared the horde_activesync_cache Table in the DB and erased the
corresponding Device entry in horde_activesync_devices Table.
(So it gave me a new device id to make sure all "old" entrys somewhere
in the DB do no longer interfere.)

After that i saw tat some Mails are sent to Outlook over and over again.

I saw repteatedly the messages:
Horde_Core_Activesync_Driver::getMessages ("Folder", xxxxx)
in the Device log with xxxx beeing the same number over and over again.

 This may be due to ther error Andreas Schneider mentioned above.
I don't use fcgi, but saw the exact same error.

I was able to identify theese mails according to the subject and
destination adress and removed them from the imap -server.

Now sync works again with this outlook client.

Perhaps this info helps sort out this error, though for me it was more
of a trial anderror approach than actual science :)

--Tom