[horde] [Same Problem] ActiveSync problem with contacts disappeared
Michael J Rubinsky
mrubinsk at horde.org
Mon Dec 28 18:38:41 UTC 2015
Please keep discussions on the mailing list, and don't top post.
Quoting Peter <horde at peter-b.org>:
> No, the test log I attached only had entries for the sync that took
> place during the addition and disappearance of the contact on the
> device.
If the contact disappeared during the time included in your log, then
it's not anything Horde did. There was NO traffic from the
device->horde to show even the attempted addition of the contact on
the phone.
> Humm, I'll do some more testing and if I can't find anything obvious
> put together a description of tests with related logs.
>
> Could you give me a list of exactly what you have installed on the
> server you mentioned, i.e. packages/modules and their related
> versions?
It's a standard, up to date Ubuntu 14.04.3 server with all packages
directly from apt-get. I'm using lighttpd as my webserver and PHP is
running as fcgi.
> I'll do a comparison with what I have and see if there's anything I
> can tweak there. Also, you mention you're running a git checkout -
> any reason for that?
Yes, because I'm a core Horde developer. I run git on my personal
server to have another test point. That point is really moot though.
Currently, the Git code for the ActiveSync library is the same as the
PEAR package. We haven't branched the library code for Horde 6 yet.
Plus, I do have multiple test VMs running PEAR installs and I do not
see this there either.
> Is it possibly worth replicating to see if that fixes my problem?
I would first update all your packages to the latest PEAR.
> Peter.
>
> On 27/12/2015 19:29, Michael J Rubinsky wrote:
>>
>> Quoting Peter <horde at peter-b.org>:
>>
>>> Thanks for taking a look Michael.
>>>
>>> C was added to the phone after the initial sync. In fact, several
>>> sync operations had already taken place at that time with various
>>> contacts added and removed.
>>
>> Ok. Well, those aren't shown in the synclog. At all.
>>
>>>
>>> I've spent a few hours methodically trying various sequences of
>>> actions, and here's what I've found:
>>>
>>> * Any contacts created on the device are lost on the next sync with
>>> the server.
>>> * Any change to contacts on the device that have come from the server
>>> are always permanently lost on the next sync with the server. Server
>>> contacts deleted on the device are not removed from the server and
>>> will re-appear the next time the server repopulates the contacts.
>>> * Contacts added on the server stay on the server and are never lost.
>>> * If contacts from the server exist on the device when modifications
>>> are made to any contact (server created or device created) on the
>>> device then all contacts (server and device created) are removed
>>> from the device at the next sync
>>> * If contacts from the server are missing from the device when a sync
>>> takes place then the device is repopulated with the contacts from
>>> the server, regardless of whether or not a contact added on the
>>> device is removed
>>>
>>> It's weird.
>>>
>>> I've scanned the logs in what limited way I can and, based on what
>>> limited knowledge I have, I can't see any communication regarding
>>> the contacts added on the device. For fun(!) I disabled SSL and
>>> had a tcpdump running for some of the sync events, and whilst I
>>> can see the device being populated with contacts I can't see
>>> anything (again, with my limited knowledge of the EAS protocol)
>>> that would obviously cause device-created contacts to be lost.
>>
>>
>> Very strange. I would say that it sounds like a badly broken
>> client, except it works on the other server. In the synclog you
>> should see client -> server <SYNC> requests (would start with an
>> "I" which stands for "Incoming"). These would have either <ADD> or
>> <CHANGE> commands containing the client changes/additions. Even if
>> there was some fatal error in the code, you would see at least the
>> start of the incoming request. If you want, I can take a look at
>> the wireshark trace just to be sure.
>>
>> Your two systems have a log of moving targets - different versions
>> of PHP, Horde etc... so it's really hard to narrow down where the
>> issue may be. I WILL say that my personal production server looks
>> alot like your problem server - Ubuntu 14.04.3 LTS / PHP 5.5.9-1
>> though it's running a Git checkout (though the ActiveSync library
>> may be the same as yours if you are up to date with the PEAR
>> updates).
>>
>> The bottom line is there is not a whole lot we can do without SOME
>> log entry somewhere giving a hint as to where this is failing. Make
>> sure you check both the synclogs, the horde log (with logging
>> bumped up to DEBUG), and the webserver error log.
>>
>>> Finally, I skimmed a logcat from the device. Again, nothing
>>> obvious, though again, I'm really not sure what I'm looking for. I
>>> can see EAS activity for the account but have no idea which, if
>>> any, of the messages may be relevant.
>>>
>>> I should point out that interspersed in this weirdness the device
>>> is configured for the old horde server mentioned below and
>>> continues to function with that server exactly as expected;
>>> contacts can be added and removed on either server or device and
>>> changes on one are reflected on the other, nothing is ever lost.
>>>
>>> I'm happy to continue testing this and provide whatever logs are
>>> necessary to find the problem. The server I'm having a problem
>>> with is a test server with no other function right now that trying
>>> to make EAS work between Horde and my device. Therefore, I'm happy
>>> to provide direct access to it should this be of help.
>>>
>>> Peter.
>>>
>>>
>>>
>>>
>>> On 27/12/2015 01:27, Michael J Rubinsky wrote:
>>>>
>>>> Quoting Peter <horde at peter-b.org>:
>>>>
>>>>> Sync log attached in zip.
>>>>>
>>>>> To cut down on noise in the log only contact sync is enabled on
>>>>> the phone.
>>>>>
>>>>> * Pre-sync, three contacts, A and B added on server and exist on
>>>>> server, C added on phone and exists on phone.
>>>>> * Mid-sync, A and B still on server, also appear on phone, C is
>>>>> removed from phone and does not appear on server
>>>>> * Post sync, A and B still on server, no contacts on phone.
>>>>>
>>>>> Peter.
>>>>
>>>>
>>>> Your sync log shows a normal initial pairing, then sending the 2
>>>> server contacts to the phone. The contact you added on the phone
>>>> is never sent to the server, and the server doesn't send any
>>>> additional data or commands to the phone (at least not in the
>>>> part of the log you sent me).
>>>>
>>>> I should mention, since it's not clear when you add "C" to the
>>>> phone, ActiveSync doesn't support synching contacts that already
>>>> exist on the phone PRIOR to creating the ActiveSync account
>>>> pairing with the server.
>>>>
>>>>
>>>>
>>>>> On 24/12/2015 16:52, Michael J Rubinsky wrote:
>>>>>>
>>>>>> Quoting Peter <horde at peter-b.org>:
>>>>>>
>>>>>>> I have exactly this problem, but the suggested solution doesn't work.
>>>>>>>
>>>>>>> Some more detail:
>>>>>>>
>>>>>>> I have a server with:
>>>>>>>
>>>>>>> Ubuntu 12.04.5 LTS
>>>>>>> PHP 5.5.21-1
>>>>>>> Horde Webmail 5.2.4 with:
>>>>>>> Horde 5.2.3
>>>>>>> Turba 4.2.4
>>>>>>> Imp 6.2.6
>>>>>>>
>>>>>>> I have an Android phone running Oxygen OS (Android 5.0.2)
>>>>>>>
>>>>>>> This combination works perfectly. Everything syncs and behaves
>>>>>>> exactly as I would expect.
>>>>>>>
>>>>>>> I have another server with:
>>>>>>>
>>>>>>> Ubuntu 14.04.3 LTS
>>>>>>> PHP 5.5.9-1
>>>>>>> Horde Webmail 5.2.11 with:
>>>>>>> Horde 5.2.8
>>>>>>> Turba 4.2.11
>>>>>>> Imp 6.2.11
>>>>>>>
>>>>>>> Using the same phone as above I get exactly the problem
>>>>>>> described below; the sync process starts, any contacts added
>>>>>>> on the phone disappear and do not appear in Turba, any
>>>>>>> contacts in Turba appear momentarily on the phone and then
>>>>>>> disappear.
>>>>>>>
>>>>>>> Any suggestions greatly appreciated, this is driving me nuts.
>>>>>>
>>>>>>
>>>>>> Please provide a sync log showing this.
>>>>>>
>>>>>>
>>>>>>>
>>>>>>> Peter.
>>>>>>>
>>>>>>>
>>>>>>> On 11/05/2014 21:35, Florian Schmidt wrote:
>>>>>>>> Top post, so you don't have to read the whole post to find
>>>>>>>> the solution:
>>>>>>>> I went to the preferences->Address Books->Synchronization
>>>>>>>> Preferences and
>>>>>>>> hit on the save button again. Now it is working again :)
>>>>>>>> (hope this saves someone else facing a similar porblem some time)
>>>>>>>>
>>>>>>>>
>>>>>>>> On Sun, May 11, 2014 at 7:21 PM, Florian Schmidt <
>>>>>>>> florian.schmidt787 at googlemail.com> wrote:
>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Sat, May 10, 2014 at 10:34 PM, Florian Schmidt <
>>>>>>>>> florian.schmidt787 at googlemail.com> wrote:
>>>>>>>>>
>>>>>>>>>> sorry, posted my answer to the wrong list, so i forward it
>>>>>>>>>> to the right
>>>>>>>>>> lsit.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> ---------- Forwarded message ----------
>>>>>>>>>> From: Florian Schmidt <florian.schmidt787 at googlemail.com>
>>>>>>>>>> Date: Sat, May 10, 2014 at 7:44 PM
>>>>>>>>>> Subject: Re: [horde] ActiveSync problem with contacts disappeared
>>>>>>>>>> To: gollem at lists.horde.org
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> On Sat, May 10, 2014 at 7:08 PM, Michael J Rubinsky
>>>>>>>>>> <mrubinsk at horde.org>wrote:
>>>>>>>>>>
>>>>>>>>>>> Quoting Florian Schmidt <florian.schmidt787 at googlemail.com>:
>>>>>>>>>>>
>>>>>>>>>>> On Sat, May 10, 2014 at 3:05 AM, Michael J Rubinsky
>>>>>>>>>>> <mrubinsk at horde.org
>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> Quoting Florian Schmidt <florian.schmidt787 at googlemail.com>:
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Fri, May 9, 2014 at 10:33 PM, Michael J Rubinsky <
>>>>>>>>>>>>> mrubinsk at horde.org
>>>>>>>>>>>>>
>>>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Quoting Florian Schmidt <florian.schmidt787 at googlemail.com>:
>>>>>>>>>>>>>>> Hi,
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> since about three days I noticed that my contacts on
>>>>>>>>>>>>>>>> my iPhone,
>>>>>>>>>>>>>>>> which I
>>>>>>>>>>>>>>>> sync with Horde via ActiveSync (Horde_ActiveSync 2.14.1)
>>>>>>>>>>>>>>>> disappeared.
>>>>>>>>>>>>>>>> Before everything worked fine, now the following happens:
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> What changed since the last time it was working? I.e., did you
>>>>>>>>>>>>>>> upgrade
>>>>>>>>>>>>>>> any
>>>>>>>>>>>>>>> packages? What packages?
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> I wasn't aware that I made any changes. I just du the
>>>>>>>>>>>>>>> regular Horde
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>> update
>>>>>>>>>>>>>> via pear. The problem occured for the first time on Monday and
>>>>>>>>>>>>>> persists
>>>>>>>>>>>>>> since then. I can still successfully receive and send emails via
>>>>>>>>>>>>>> ActiveSync
>>>>>>>>>>>>>> and also sync tasks.
>>>>>>>>>>>>>> ]
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>> So, you updated to the latest alpha releases, or no?
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> No, I did not update to alpha, just to the production
>>>>>>>>>>>>> releases, e.g.
>>>>>>>>>>>> I am
>>>>>>>>>>>> running Horde 5.1.6 and Turba 4.1.4
>>>>>>>>>>>>
>>>>>>>>>>> Not sure then. Works fine here. Nothing in the current
>>>>>>>>>>> stable changed
>>>>>>>>>>> recently with regards to determining the address books to
>>>>>>>>>>> sync. You can try
>>>>>>>>>>> resetting your address books sync preferences and see if
>>>>>>>>>>> that helps.
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>> Hm, I have removed the account on my devices and reentered
>>>>>>>>>> it (all are
>>>>>>>>>> affected by the problem). I have reprovisoned teh devices
>>>>>>>>>> from Horde. I
>>>>>>>>>> have restarted all devices and teh server. I have looked at
>>>>>>>>>> the logs and
>>>>>>>>>> not seen anything special. Do you have any suggestion what
>>>>>>>>>> else I could
>>>>>>>>>> try? Or maybe is there something specific in the active
>>>>>>>>>> sync log file I
>>>>>>>>>> coul be looking for?
>>>>>>>>>> Still I can add adresses on my iOS device, which are then
>>>>>>>>>> synced to the
>>>>>>>>>> server, but as soon as I do update them, they disappear on
>>>>>>>>>> the devices.
>>>>>>>>>> Seems like somehow they are not transferred to teh device
>>>>>>>>>> anymore for some
>>>>>>>>>> reason. I did not find the exact SQL query, which requests
>>>>>>>>>> the data from
>>>>>>>>>> teh data base, which iwl be sent to the device. Can you
>>>>>>>>>> point me at the
>>>>>>>>>> direction, where I can find this query? I suppose, this
>>>>>>>>>> could be a good
>>>>>>>>>> starting point for further debugging.
>>>>>>>>>>
>>>>>>>>>> Best regards
>>>>>>>>>> Flo
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>> Hm, I am further investigating and I am not sure if the following is
>>>>>>>>> expected behavior or if it might be related to my problem:
>>>>>>>>> If I create an address book entry on my iPhone via active
>>>>>>>>> sync, then in
>>>>>>>>> the webinteface it is said 'created by 0' instead of 'created by me'.
>>>>>>>>> Also, if I do the following
>>>>>>>>> SELECT * FROM horde_histories WHERE object_uid LIKE
>>>>>>>>> 'turba:%' ORDER BY
>>>>>>>>> history_modseq DESC
>>>>>>>>> the recent entries (created via ActiveSync) do not show my
>>>>>>>>> Horde id in
>>>>>>>>> history_who but a 0.
>>>>>>>>> Can this be part of the problem? Then, where might it be coming from?
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>> mike
>>>>>>>>>>> The Horde Project
>>>>>>>>>>> http://www.horde.org
>>>>>>>>>>> https://www.facebook.com/hordeproject
>>>>>>>>>>> https://www.twitter.com/hordeproject
>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>> Horde mailing list
>>>>>>>>>>> Frequently Asked Questions: http://horde.org/faq/
>>>>>>>>>>> To unsubscribe, mail: horde-unsubscribe at lists.horde.org
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Horde mailing list
>>>>>>> Frequently Asked Questions: http://horde.org/faq/
>>>>>>> To unsubscribe, mail: horde-unsubscribe at lists.horde.org
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>
>>> --
>>> Horde mailing list
>>> Frequently Asked Questions: http://horde.org/faq/
>>> To unsubscribe, mail: horde-unsubscribe at lists.horde.org
>>
>>
>>
>>
--
mike
The Horde Project
http://www.horde.org
https://www.facebook.com/hordeproject
https://www.twitter.com/hordeproject
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 5751 bytes
Desc: S/MIME Signature
URL: <http://lists.horde.org/archives/horde/attachments/20151228/87349a79/attachment.bin>
More information about the horde
mailing list