[horde] [Same Problem] ActiveSync problem with contacts disappeared

Michael J Rubinsky mrubinsk at horde.org
Sun Dec 27 19:29:08 UTC 2015 

Quoting Peter <horde at peter-b.org>:

> Thanks for taking a look Michael.
>
> C was added to the phone after the initial sync. In fact, several  
> sync operations had already taken place at that time with various  
> contacts added and removed.

Ok. Well, those aren't shown in the synclog. At all.

>
> I've spent a few hours methodically trying various sequences of  
> actions, and here's what I've found:
>
>  * Any contacts created on the device are lost on the next sync with
>    the server.
>  * Any change to contacts on the device that have come from the server
>    are always permanently lost on the next sync with the server. Server
>    contacts deleted on the device are not removed from the server and
>    will re-appear the next time the server repopulates the contacts.
>  * Contacts added on the server stay on the server and are never lost.
>  * If contacts from the server exist on the device when modifications
>    are made to any contact (server created or device created) on the
>    device then all contacts (server and device created) are removed
>    from the device at the next sync
>  * If contacts from the server are missing from the device when a sync
>    takes place then the device is repopulated with the contacts from
>    the server, regardless of whether or not a contact added on the
>    device is removed
>
> It's weird.
>
> I've scanned the logs in what limited way I can and, based on what  
> limited knowledge I have, I can't see any communication regarding  
> the contacts added on the device. For fun(!) I disabled SSL and had  
> a tcpdump running for some of the sync events, and whilst I can see  
> the device being populated with contacts I can't see anything  
> (again, with my limited knowledge of the EAS protocol) that would  
> obviously cause device-created contacts to be lost.


Very strange. I would say that it sounds like a badly broken client,  
except it works on the other server. In the synclog you should see  
client -> server <SYNC> requests (would start with an "I" which stands  
for "Incoming"). These would have either <ADD> or <CHANGE> commands  
containing the client changes/additions. Even if there was some fatal  
error in the code, you would see at least the start of the incoming  
request. If you want, I can take a look at the wireshark trace just to  
be sure.

Your two systems have a log of moving targets - different versions of  
PHP, Horde etc... so it's really hard to narrow down where the issue  
may be. I WILL say that my personal production server looks alot like  
your problem server - Ubuntu 14.04.3 LTS / PHP 5.5.9-1 though it's  
running a Git checkout (though the ActiveSync library may be the same  
as yours if you are up to date with the PEAR updates).

The bottom line is there is not a whole lot we can do without SOME log  
entry somewhere giving a hint as to where this is failing. Make sure  
you check both the synclogs, the horde log (with logging bumped up to  
DEBUG), and the webserver error log.

> Finally, I skimmed a logcat from the device. Again, nothing obvious,  
> though again, I'm really not sure what I'm looking for. I can see  
> EAS activity for the account but have no idea which, if any, of the  
> messages may be relevant.
>
> I should point out that interspersed in this weirdness the device is  
> configured for the old horde server mentioned below and continues to  
> function with that server exactly as expected; contacts can be added  
> and removed on either server or device and changes on one are  
> reflected on the other, nothing is ever lost.
>
> I'm happy to continue testing this and provide whatever logs are  
> necessary to find the problem. The server I'm having a problem with  
> is a test server with no other function right now that trying to  
> make EAS work between Horde and my device. Therefore,  I'm happy to  
> provide direct access to it should this be of help.
>
> Peter.
>
>
>
>
> On 27/12/2015 01:27, Michael J Rubinsky wrote:
>>
>> Quoting Peter <horde at peter-b.org>:
>>
>>> Sync log attached in zip.
>>>
>>> To cut down on noise in the log only contact sync is enabled on the phone.
>>>
>>> * Pre-sync, three contacts, A and B added on server and exist on
>>>   server, C added on phone and exists on phone.
>>> * Mid-sync, A and B still on server, also appear on phone, C is
>>>   removed from phone and does not appear on server
>>> * Post sync, A and B still on server, no contacts on phone.
>>>
>>> Peter.
>>
>>
>> Your sync log shows a normal initial pairing, then sending the 2  
>> server contacts to the phone. The contact you added on the phone is  
>> never sent to the server, and the server doesn't send any  
>> additional data or commands to the phone (at least not in the part  
>> of the log you sent me).
>>
>> I should mention, since it's not clear when you add "C" to the  
>> phone, ActiveSync doesn't support synching contacts that already  
>> exist on the phone PRIOR to creating the ActiveSync account pairing  
>> with the server.
>>
>>
>>
>>> On 24/12/2015 16:52, Michael J Rubinsky wrote:
>>>>
>>>> Quoting Peter <horde at peter-b.org>:
>>>>
>>>>> I have exactly this problem, but the suggested solution doesn't work.
>>>>>
>>>>> Some more detail:
>>>>>
>>>>> I have a server with:
>>>>>
>>>>> Ubuntu 12.04.5 LTS
>>>>> PHP 5.5.21-1
>>>>> Horde Webmail 5.2.4 with:
>>>>> Horde 5.2.3
>>>>> Turba 4.2.4
>>>>> Imp 6.2.6
>>>>>
>>>>> I have an Android phone running Oxygen OS (Android 5.0.2)
>>>>>
>>>>> This combination works perfectly. Everything syncs and behaves  
>>>>> exactly as I would expect.
>>>>>
>>>>> I have another server with:
>>>>>
>>>>> Ubuntu 14.04.3 LTS
>>>>> PHP 5.5.9-1
>>>>> Horde Webmail 5.2.11 with:
>>>>> Horde 5.2.8
>>>>> Turba 4.2.11
>>>>> Imp 6.2.11
>>>>>
>>>>> Using the same phone as above I get exactly the problem  
>>>>> described below; the sync process starts, any contacts added on  
>>>>> the phone disappear and do not appear in Turba, any contacts in  
>>>>> Turba appear momentarily on the phone and then disappear.
>>>>>
>>>>> Any suggestions greatly appreciated, this is driving me nuts.
>>>>
>>>>
>>>> Please provide a sync log showing this.
>>>>
>>>>
>>>>>
>>>>> Peter.
>>>>>
>>>>>
>>>>> On 11/05/2014 21:35, Florian Schmidt wrote:
>>>>>> Top post, so you don't have to read the whole post to find the solution:
>>>>>> I went to the preferences->Address Books->Synchronization  
>>>>>> Preferences and
>>>>>> hit on the save button again. Now it is working again :)
>>>>>> (hope this saves someone else facing a similar porblem some time)
>>>>>>
>>>>>>
>>>>>> On Sun, May 11, 2014 at 7:21 PM, Florian Schmidt <
>>>>>> florian.schmidt787 at googlemail.com> wrote:
>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On Sat, May 10, 2014 at 10:34 PM, Florian Schmidt <
>>>>>>> florian.schmidt787 at googlemail.com> wrote:
>>>>>>>
>>>>>>>> sorry, posted my answer to the wrong list, so i forward it to  
>>>>>>>> the right
>>>>>>>> lsit.
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> ---------- Forwarded message ----------
>>>>>>>> From: Florian Schmidt <florian.schmidt787 at googlemail.com>
>>>>>>>> Date: Sat, May 10, 2014 at 7:44 PM
>>>>>>>> Subject: Re: [horde] ActiveSync problem with contacts disappeared
>>>>>>>> To: gollem at lists.horde.org
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On Sat, May 10, 2014 at 7:08 PM, Michael J Rubinsky  
>>>>>>>> <mrubinsk at horde.org>wrote:
>>>>>>>>
>>>>>>>>> Quoting Florian Schmidt <florian.schmidt787 at googlemail.com>:
>>>>>>>>>
>>>>>>>>> On Sat, May 10, 2014 at 3:05 AM, Michael J Rubinsky  
>>>>>>>>> <mrubinsk at horde.org
>>>>>>>>>>> wrote:
>>>>>>>>>>
>>>>>>>>>>> Quoting Florian Schmidt <florian.schmidt787 at googlemail.com>:
>>>>>>>>>>>
>>>>>>>>>>> On Fri, May 9, 2014 at 10:33 PM, Michael J Rubinsky <
>>>>>>>>>>> mrubinsk at horde.org
>>>>>>>>>>>
>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>> Quoting Florian Schmidt <florian.schmidt787 at googlemail.com>:
>>>>>>>>>>>>> Hi,
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>> since about three days I noticed that my contacts on my iPhone,
>>>>>>>>>>>>>> which I
>>>>>>>>>>>>>> sync with Horde via ActiveSync (Horde_ActiveSync 2.14.1)
>>>>>>>>>>>>>> disappeared.
>>>>>>>>>>>>>> Before everything worked fine, now the following happens:
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> What changed since the last time it was working? I.e., did you
>>>>>>>>>>>>> upgrade
>>>>>>>>>>>>> any
>>>>>>>>>>>>> packages? What packages?
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> I wasn't aware that I made any changes. I just du the  
>>>>>>>>>>>>> regular Horde
>>>>>>>>>>>>>
>>>>>>>>>>>> update
>>>>>>>>>>>> via pear. The problem occured for the first time on Monday and
>>>>>>>>>>>> persists
>>>>>>>>>>>> since then. I can still successfully receive and send emails via
>>>>>>>>>>>> ActiveSync
>>>>>>>>>>>> and also sync tasks.
>>>>>>>>>>>> ]
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>> So, you updated to the latest alpha releases, or no?
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> No, I did not update to alpha, just to the production  
>>>>>>>>>>> releases, e.g.
>>>>>>>>>> I am
>>>>>>>>>> running Horde 5.1.6 and Turba 4.1.4
>>>>>>>>>>
>>>>>>>>> Not sure then. Works fine here. Nothing in the current stable changed
>>>>>>>>> recently with regards to determining the address books to  
>>>>>>>>> sync. You can try
>>>>>>>>> resetting your address books sync preferences and see if that helps.
>>>>>>>>>
>>>>>>>>>
>>>>>>>> Hm, I have removed the account on my devices and reentered it (all are
>>>>>>>> affected by the problem). I have reprovisoned teh devices  
>>>>>>>> from Horde. I
>>>>>>>> have restarted all devices and teh server. I have looked at  
>>>>>>>> the logs and
>>>>>>>> not seen anything special. Do you have any suggestion what  
>>>>>>>> else I could
>>>>>>>> try? Or maybe is there something specific in the active sync  
>>>>>>>> log file I
>>>>>>>> coul be looking for?
>>>>>>>> Still I can add adresses on my iOS device, which are then  
>>>>>>>> synced to the
>>>>>>>> server, but as soon as I do update them, they disappear on  
>>>>>>>> the devices.
>>>>>>>> Seems like somehow they are not transferred to teh device  
>>>>>>>> anymore for some
>>>>>>>> reason. I did not find the exact SQL query, which requests  
>>>>>>>> the data from
>>>>>>>> teh data base, which iwl be sent to the device. Can you point  
>>>>>>>> me at the
>>>>>>>> direction, where I can find this query? I suppose, this could  
>>>>>>>> be a good
>>>>>>>> starting point for further debugging.
>>>>>>>>
>>>>>>>> Best regards
>>>>>>>> Flo
>>>>>>>>
>>>>>>>>
>>>>>>> Hm, I am further investigating and I am not sure if the following is
>>>>>>> expected behavior or if it might be related to my problem:
>>>>>>> If I create an address book entry on my iPhone via active sync, then in
>>>>>>> the webinteface it is said 'created by 0' instead of 'created by me'.
>>>>>>> Also, if I do the following
>>>>>>> SELECT * FROM horde_histories WHERE object_uid LIKE 'turba:%' ORDER BY
>>>>>>> history_modseq DESC
>>>>>>> the recent entries (created via ActiveSync) do not show my Horde id in
>>>>>>> history_who but a 0.
>>>>>>> Can this be part of the problem? Then, where might it be coming from?
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>>
>>>>>>>>> -- 
>>>>>>>>> mike
>>>>>>>>> The Horde Project
>>>>>>>>> http://www.horde.org
>>>>>>>>> https://www.facebook.com/hordeproject
>>>>>>>>> https://www.twitter.com/hordeproject
>>>>>>>>>
>>>>>>>>> -- 
>>>>>>>>> Horde mailing list
>>>>>>>>> Frequently Asked Questions: http://horde.org/faq/
>>>>>>>>> To unsubscribe, mail: horde-unsubscribe at lists.horde.org
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>
>>>>> -- 
>>>>> Horde mailing list
>>>>> Frequently Asked Questions: http://horde.org/faq/
>>>>> To unsubscribe, mail: horde-unsubscribe at lists.horde.org
>>>>
>>>>
>>>>
>>>>
>>>>
>>
>>
>>
>>
>>
>
> -- 
> Horde mailing list
> Frequently Asked Questions: http://horde.org/faq/
> To unsubscribe, mail: horde-unsubscribe at lists.horde.org


-- 
mike
The Horde Project
http://www.horde.org
https://www.facebook.com/hordeproject
https://www.twitter.com/hordeproject
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 5751 bytes
Desc: S/MIME Signature
URL: <http://lists.horde.org/archives/horde/attachments/20151227/becfea0a/attachment.bin>

More information about the horde mailing list