used_file_size too large

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
6 messages Options
Reply | Threaded
Open this post in threaded view
|

used_file_size too large

Anders-19
Hi.

Just got this error (1.1.rc4), is it something to worry about?

Corrupted index cache file /.../Maildir/.Sent/dovecot.index.cache:
used_file_size too large

This is a shared mailbox with concurrent access. In general, can that
usage pattern mess up the index? I am guessing "no", which is why I worry
slightly about the warning.


Cheers,
Anders.


Reply | Threaded
Open this post in threaded view
|

Re: used_file_size too large

Timo Sirainen
On Fri, 2008-05-02 at 11:09 +0200, Anders wrote:
> Hi.
>
> Just got this error (1.1.rc4), is it something to worry about?
>
> Corrupted index cache file /.../Maildir/.Sent/dovecot.index.cache:
> used_file_size too large

This gets automatically fixed and it's invisible to users, but it
shouldn't happen of course.

What OS and filesystem are you using? Anything special like
NFS/clusterfs/etc.? Could you post your dovecot -n output?

Can you reproduce this using imaptest stress testing?
http://imapwiki.org/ImapTest

> This is a shared mailbox with concurrent access. In general, can that
> usage pattern mess up the index? I am guessing "no", which is why I worry
> slightly about the warning.

Shared mailboxes should be no different from a single user using
multiple connections to the same mailbox.

signature.asc (196 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: used_file_size too large

Anders-19
Timo Sirainen wrote:
> On Fri, 2008-05-02 at 11:09 +0200, Anders wrote:
>>
>> Corrupted index cache file /.../Maildir/.Sent/dovecot.index.cache:
>> used_file_size too large
>
> What OS and filesystem are you using? Anything special like
> NFS/clusterfs/etc.? Could you post your dovecot -n output?

This was on Linux with ext3, nothing special. My dovecot -n output is below.

> Can you reproduce this using imaptest stress testing?
> http://imapwiki.org/ImapTest

I am not quite sure how to run this. Do I set up a dummy account? Which
options are useful for this case?


Thanks,
Anders.



# 1.1.rc4: /usr/local/dovecot-1.1rc4/etc/dovecot.conf
protocols: imap imaps managesieve
listen(default): 127.0.0.1
listen(imap): 127.0.0.1
listen(managesieve): *
ssl_listen(default): *
ssl_listen(imap): *
ssl_listen(managesieve):
ssl_cert_file: /etc/ssl/private/dovecot.pem
disable_plaintext_auth: no
login_dir: /usr/local/dovecot-1.1rc4/var/run/dovecot/login
login_executable(default):
/usr/local/dovecot-1.1rc4/libexec/dovecot/imap-login
login_executable(imap): /usr/local/dovecot-1.1rc4/libexec/dovecot/imap-login
login_executable(managesieve):
/usr/local/dovecot-1.1rc4/libexec/dovecot/managesieve-login
login_user: doveauth
login_processes_count: 32
login_max_processes_count: 1200
valid_chroot_dirs: /var/mail/vhosts
mail_uid: vmail
mail_gid: vmail
mail_location: maildir:~/Maildir
mail_executable(default): /usr/local/dovecot-1.1rc4/libexec/dovecot/imap
mail_executable(imap): /usr/local/dovecot-1.1rc4/libexec/dovecot/imap
mail_executable(managesieve):
/usr/local/dovecot-1.1rc4/libexec/dovecot/managesieve
mail_plugins(default): mail_log quota imap_quota acl
mail_plugins(imap): mail_log quota imap_quota acl
mail_plugins(managesieve):
mail_plugin_dir(default): /usr/local/dovecot-1.1rc4/lib/dovecot/imap
mail_plugin_dir(imap): /usr/local/dovecot-1.1rc4/lib/dovecot/imap
mail_plugin_dir(managesieve):
/usr/local/dovecot-1.1rc4/lib/dovecot/managesieve
imap_client_workarounds(default): delay-newmail
imap_client_workarounds(imap): delay-newmail
imap_client_workarounds(managesieve):
sieve_storage(default):
sieve_storage(imap):
sieve_storage(managesieve): ~/sieve
sieve(default):
sieve(imap):
sieve(managesieve): ~/.dovecot.sieve-not
auth default:
   mechanisms: plain login
   user: dovecot
   master_user_separator: *
   passdb:
     driver: passwd-file
     args: /usr/local/dovecot/etc/passwd.masterusers
     pass: yes
     master: yes
   passdb:
     driver: ldap
     args: /usr/local/dovecot/etc/dovecot-ldap.conf
   userdb:
     driver: ldap
     args: /usr/local/dovecot/etc/dovecot-ldap.conf
   socket:
     type: listen
     client:
       path: /var/spool/postfix/private/auth
       mode: 432
       user: postfix
       group: postfix
     master:
       path: /usr/local/dovecot/var/run/dovecot/auth-master
       mode: 384
       user: vmail
       group: vmail
plugin:
   quota: maildir
   quota_rule: *:bytes=0
   quota_warning: storage=95%% /usr/local/bin/quota-warning 95
   quota_warning2: storage=80%% /usr/local/bin/quota-warning 80
   acl: vfile:/etc/dovecot-acls:cache_secs=300
dict:
   expire: db:/usr/local/dovecot/var/expire.db

Reply | Threaded
Open this post in threaded view
|

Re: used_file_size too large

Timo Sirainen
On May 4, 2008, at 2:20 PM, Anders wrote:

>> Can you reproduce this using imaptest stress testing?
>> http://imapwiki.org/ImapTest
>
> I am not quite sure how to run this. Do I set up a dummy account?

Yes, that would be the safest way not to lose your mails. :) You could  
also use box=testbox parameter, which *should* not mess anything up in  
other mailboxes. The default mailbox is anyway INBOX, so if you happen  
to forget that parameter your INBOX is pretty much gone.

> Which options are useful for this case?

These should work:

./imaptest user=testuser pass=testpass host=localhost mbox=dovecot-
crlf logout=0

Get dovecot-crlf from http://dovecot.org/tmp/dovecot-crlf

You could also try without logout=0 to see if that changes anything.


PGP.sig (201 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: used_file_size too large

Anders-19
Timo Sirainen wrote:

> ./imaptest user=testuser pass=testpass host=localhost mbox=dovecot-
> crlf logout=0

I tried running this for a little while, and did not see the index
corruption warning in the logs.

Could an unclean shutdown corrupt the index? I have been experimenting a
bit, so lots of restarts.


Regards,
Anders.

Reply | Threaded
Open this post in threaded view
|

Re: used_file_size too large

Timo Sirainen
On Sun, 2008-05-04 at 14:54 +0200, Anders wrote:

> Timo Sirainen wrote:
>
> > ./imaptest user=testuser pass=testpass host=localhost mbox=dovecot-
> > crlf logout=0
>
> I tried running this for a little while, and did not see the index
> corruption warning in the logs.
>
> Could an unclean shutdown corrupt the index? I have been experimenting a
> bit, so lots of restarts.
I guess it's possible if you're not using data=journal mount option.

signature.asc (196 bytes) Download Attachment