offlineimap optimisations

[martin f krafft <madduck@xxxxxxxxxxx>]

Hi,
trying to sync a 150k message mailbox (which isn't my first time),
I ran into some performance issues which made me look at offlineimap
strace output.

There, I noticed two things:

1. offlineimap *churns* through PIDs. I know the programme uses
   threads, but in my understanding, threads don't eat PIDs, only
   forks do. So what is it doing, consuming somewhere in the
   vicinity of 100 PIDs per minute?

2. I see a lot of
     [pid 19379] 
rename("/home/madduck/.var/offlineimap/Account-seamus.madduck.net/LocalStatus/spool.tmp",
 "/home/madduck/.var/offlineimap/Account-seamus.madduck.net/LocalStatus/spool") 
= 0
   in the output, and it makes me think that offlineimap rewrites
   the database after every message it receives. I know sqlite
   integration is in the works, but maybe a journaling approach
   would be better, writing changes to a journal and merging it in
   on completion, or whenever there's time.

This just up for discussion. I know I should be hacking on the code
instead. Sorry John! :)

-- 
martin | http://madduck.net/ | http://two.sentenc.es/
 
an avocado-tone refrigerator would look good on your resume.
 
spamtraps: madduck.bogus@xxxxxxxxxxx

-- Attached file included as plaintext by Ecartis --
-- File: digital_signature_gpg.asc
-- Desc: Digital signature (see http://martin-krafft.net/gpg/)

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.6 (GNU/Linux)

iD8DBQFIKVVFIgvIgzMMSnURAiIhAJ4i7QiuAg/FJcq2cZL4roUiYuF+ZQCg6Nc2
x0KEdqRQN5Ay0HiUSXDn88M=
=dW+m
-----END PGP SIGNATURE-----