[horde] Kronolith Import ics Problem

[Michael J Rubinsky]

Quoting Jens Hellermann <hellermann at we-do.com>:

> ________
> Am 30.07.2015 um 15:59 schrieb Michael J Rubinsky:
>
>>
>> Quoting Jens Hellermann <hellermann at we-do.com>:
>>
>>> Am 30.07.2015 um 12:25 schrieb Jens Hellermann:
>>>> Am 29.07.2015 um 15:34 schrieb Jens Hellermann:
>>>>> Am 29.07.2015 um 15:11 schrieb Jens Hellermann:
>>>>>> Am 29.07.2015 um 12:02 schrieb Jens Hellermann:
>>>>>>> Am 29.07.2015 um 11:17 schrieb David Benfell:
>>>>>>>> Quoting Jens Hellermann <hellermann at we-do.com>:
>>>>>>>>
>>>>>>>>> Dear Horde List Members,
>>>>>>>>>
>>>>>>>>> I'm busy testing how to import calendars that have been  
>>>>>>>>> maintained on my old system into horde. Some Calendars  
>>>>>>>>> especially small ones <1 MB  import without problems. But we  
>>>>>>>>> have complex calendars that have up to 20 MB and the import  
>>>>>>>>> into horde webmail fails. The syslog doesn't give out much  
>>>>>>>>> information:
>>>>>>>>
>>>>>>>> This isn't a PHP upload size limit problem is it?
>>>>>>> Hi David, yes it is . Also had to increase memory limit  
>>>>>>> afterwords and increase execution time to 600. It looks much  
>>>>>>> better now and I can see first importing successes from alerts  
>>>>>>> popping up, but I don't see the whole calendar in the end. I  
>>>>>>> wish I could follow up on the progress of the calendar import  
>>>>>>> in a log. Have you got an idea where to look?
>>>>>>>
>>>>>>> Update: Also I get several errors in syslog:
>>>>>>>
>>>>>>> HORDE: [kronolith] Call to a member function addException() on  
>>>>>>> a non-object [pid 17484 on line 1445 of  
>>>>>>> "/var/www/horde/kronolith/lib/Event.php"]
>>>>>>>
>>>>>>> Kind regards, Jens.
>>>>>>>
>>>>>> Update: Import seems to be successfull, but is horribly slow: I  
>>>>>> took probes by exporting the calendar to compare its original  
>>>>>> size (26MB) to the export file. I then realized that the  
>>>>>> exportet file grows steadily in size:
>>>>>>
>>>>>> 14:38:01        start import
>>>>>> 14:53:10        741 KB
>>>>>> 14:58:07        882 KB
>>>>>> 15:08:20        916 KB
>>>>>>
>>>>>> So my beautifull Horde installation imports slower than a 56k  
>>>>>> modem. I can hear my hair grow. Anyone? Pls.????
>>>>> Question: Thunderbird seems to handle the import process quite  
>>>>> well, but all events with atendees cause automated invitations  
>>>>> to be send out. I guess this is not a thunderbird setting, as it  
>>>>> doesn't happen on local calendars. The invitations are triggered  
>>>>> while the events are created in kronolith. It could be a good  
>>>>> work around to just surpress these invitations during import,  
>>>>> but I didn't find any variable in the prefs.php to do so. Ideas  
>>>>> welcome! Kind regards, Jens.
>>>>>
>>>> Update: I googled general problems in connection speed from php  
>>>> to mysql and came along an article, that describes how a IPv4 and  
>>>> IPv6 conflict can cause timeouts:
>>>>
>>>> http://serverfault.com/questions/408550/connecting-to-mysql-from-php-is-extremely-slow For fist testing I added  --skip-name-resolve to my.cnf and changed |--bind-address= 127.0.0.1 to  
>>>> ::.
>>>>
>>>> That definitely speeds up the import process and momentarilly I  
>>>> experiment with the values max_execution_time and max_input_time  
>>>> in php.ini. An older example of import problems brought me this  
>>>> information. It proposes changing some maximum variable lenghts  
>>>> in the sql backend, but that didn't increase the amount of data I  
>>>> can import:
>>>>
>>>> http://lists.horde.org/archives/kronolith/Week-of-Mon-20120402/008096.html It still stops at 1,7 MB without giving out any errors in the syslog. Any additional ideas are greatly  
>>>> appreciated.
>>>>
>>> Update: I believe I found the problem that keeps kronolith from  
>>> importing all the .ics file. Obviously horde cannot handle events  
>>> created in Outlook that have file attachments like PDFs. Going  
>>> through the .ics file I found that these parts of the file always  
>>> start with ATTACH;VALUE=BINARY;X-FILENAME until CATEGORIES or  
>>> DTSTART (if no categorie given) follows.
>>>
>>> Now I wonder if I can make kronolith ignore these passages, or if  
>>> I have to write a script that removes these attachments. Comments  
>>> are welcome!
>>
>> Have you first verified that this is indeed the cause? I.e., tried  
>> a smaller import with and without these entries?
> Yes I did. Import failed when the attachment was still in the .ics  
> (only one schedule). It didn't when I removed it. Kind regards, Jens.


Please create a ticket on bugs.horde.org with an example .ics file if  
possible.


-- 
mike
The Horde Project
http://www.horde.org
https://www.facebook.com/hordeproject
https://www.twitter.com/hordeproject
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 5869 bytes
Desc: S/MIME Signature
URL: <http://lists.horde.org/archives/horde/attachments/20150730/328dedbe/attachment.bin>