Bug in dovecot 2.3 virtual plugin

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
11 messages Options
Reply | Threaded
Open this post in threaded view
|

Bug in dovecot 2.3 virtual plugin

Jakob Schürz
Hi there!

I compiled dovecot 2.3 from git. Because there is already a bug in  
virtual-plugin, and i hoped, it get fixed... but it doesn't. So this  
is the error-message from the log

Jän 03 16:27:08 aldebaran dovecot[26460]:  
indexer-worker(jakob)<26476><qQ6g1+BhIJvAqAAO:sjYhMTH2TFpsZwAAk1Mx3g>:  
Panic: file unichar.c: line 160 (uni_ucs4_to_utf8_c): assertion  
failed: (uni_is_valid_ucs4(chr))
Jän 03 16:27:08 aldebaran dovecot[26460]:  
indexer-worker(jakob)<26476><qQ6g1+BhIJvAqAAO:sjYhMTH2TFpsZwAAk1Mx3g>:  
Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0xc6021)  
[0x7f8299f7a021] -> /usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed)  
[0x7f8299f7a0ed] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0)  
[0x7f8299eec481] ->  
/usr/local/lib/dovecot/libdovecot.so.0(uni_ucs4_to_utf8_c+0xa0)  
[0x7f8299fb1500] -> /usr/local/lib/dovecot/libdovecot.so.0(+0xa75e0)  
[0x7f8299f5b5e0] ->  
/usr/local/lib/dovecot/libdovecot.so.0(mail_html2text_more+0xc5)  
[0x7f8299f5b775] ->  
/usr/local/lib/dovecot/lib20_fts_plugin.so(+0xcfcc) [0x7f82990aefcc]  
-> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_parser_more+0x27)  
[0x7f82990aeca7] ->  
/usr/local/lib/dovecot/lib20_fts_plugin.so(fts_build_mail+0x5e9)  
[0x7f82990acc39] ->  
/usr/local/lib/dovecot/lib20_fts_plugin.so(+0x1122d) [0x7f82990b322d]  
-> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x916a)  
[0x7f82958e316a] ->  
/usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10f5d) [0x7f82990b2f5d]  
-> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x916a)  
[0x7f82958e316a] ->  
/usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10f5d) [0x7f82990b2f5d]  
-> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_precache+0x2e)  
[0x7f829a2641be] -> dovecot/indexer-worker [jakob  
Synoptic/AKTUELL](+0x2533) [0x562227882533] ->  
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69)  
[0x7f8299f91bf9] ->  
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109)  
[0x7f8299f93499] ->  
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52)  
[0x7f8299f91d02] ->  
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38)  
[0x7f8299f91f18] ->  
/usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13)  
[0x7f8299f0f1e3] -> dovecot/indexer-worker [jakob  
Synoptic/AKTUELL](main+0xe7) [0x562227881f47] ->  
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1)  
[0x7f8299b352b1] -> dovecot/indexer-worker [jakob  
Synoptic/AKTUELL](_start+0x2a) [0x56222788201a]
Jän 03 16:27:08 aldebaran dovecot[26460]: indexer: Error: Indexer  
worker disconnected, discarding 1 requests for jakob
Jän 03 16:27:08 aldebaran dovecot[26460]:  
imap(jakob)<26472><qQ6g1+BhIJvAqAAO>: Error: indexer failed to index  
mailbox Synoptic/AKTUELL
Jän 03 16:27:08 aldebaran dovecot[26460]:  
indexer-worker(jakob)<26476><qQ6g1+BhIJvAqAAO:sjYhMTH2TFpsZwAAk1Mx3g>:  
Fatal: master: service(indexer-worker): child 26476 killed with signal  
6 (core dumps disabled)
Jän 03 16:27:09 aldebaran dovecot[26460]:  
indexer-worker(jakob)<26484><qQ6g1+BhIJvAqAAO:J6mUIEz2TFp0ZwAAk1Mx3g>:  
Error: lucene index  
/var/lib/dovecot/db/indexes/Maildir/jakob/lucene-indexes:  
IndexWriter() failed (#1): Lock obtain timed out
Jän 03 16:27:10 aldebaran dovecot[26460]:  
indexer-worker(jakob)<26484><qQ6g1+BhIJvAqAAO:J6mUIEz2TFp0ZwAAk1Mx3g>:  
Error: Mailbox Synoptic/AKTUELL: Transaction commit failed: BUG:  
Unknown internal error (attempted to index 1488 messages (UIDs  
15214..16775))
Jän 03 16:27:10 aldebaran dovecot[26460]:  
imap(jakob)<26480><lP5r2OBhKJvAqAAO>: Error: indexer failed to index  
mailbox Synoptic/AKTUELL
Jän 03 16:27:11 aldebaran dovecot[26460]:  
imap(jakob)<26472><qQ6g1+BhIJvAqAAO>: Panic: file mail-index.c: line  
793 (mail_index_close): assertion failed: (index->open_count > 0)
Jän 03 16:27:11 aldebaran dovecot[26460]:  
imap(jakob)<26472><qQ6g1+BhIJvAqAAO>: Error: Raw backtrace:  
/usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7fb0fbd3a021] ->  
/usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7fb0fbd3a0ed] ->  
/usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fb0fbcac481] ->  
/usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf39a8)  
[0x7fb0fc0d99a8] ->  
/usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd92d1)  
[0x7fb0fc0bf2d1] ->  
/usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd9363)  
[0x7fb0fc0bf363] ->  
/usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_free+0x9)  
[0x7fb0fc0b0f39] ->  
/usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd05a4)  
[0x7fb0fc0b65a4] ->  
/usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_free+0x19)  
[0x7fb0fc030c99] ->  
/usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xabdc)  
[0x7fb0f729bbdc] ->  
/usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xacb9)  
[0x7fb0f729bcb9] ->  
/usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a)  
[0x7fb0fc030c0a] ->  
/usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xac60)  
[0x7fb0f729bc60] ->  
/usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xacb9)  
[0x7fb0f729bcb9] ->  
/usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a)  
[0x7fb0fc030c0a] ->  
/usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_free+0x13)  
[0x7fb0fc030c93] -> dovecot/imap [jakob 192.168.0.14  
LOGOUT](imap_client_close_mailbox+0x5b) [0x56514d31305b] ->  
dovecot/imap [jakob 192.168.0.14 LOGOUT](cmd_logout+0x35)  
[0x56514d309485] -> dovecot/imap [jakob 192.168.0.14  
LOGOUT](command_exec+0x64) [0x56514d312ca4] -> dovecot/imap [jakob  
192.168.0.14 LOGOUT](+0x1b0b2) [0x56514d3110b2] -> dovecot/imap [jakob  
192.168.0.14 LOGOUT](+0x1b13c) [0x56514d31113c] -> dovecot/imap [jakob  
192.168.0.14 LOGOUT](client_handle_input+0x1a5) [0x56514d311565] ->  
dovecot/imap [jakob 192.168.0.14 LOGOUT](client_input+0x82)  
[0x56514d311be2] ->  
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69)  
[0x7fb0fbd51bf9] ->  
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109)  
[0x7fb0fbd53499] ->  
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52)  
[0x7fb0fbd51d02] ->  
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38)  
[0x7fb0fbd51f18] ->  
/usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13)  
[0x7fb0fbccf1e3]
Jän 03 16:27:11 aldebaran dovecot[26460]:  
imap(jakob)<26472><qQ6g1+BhIJvAqAAO>: Fatal: master: service(imap):  
child 26472 killed with signal 6 (core dumps disabled)


I get this errors when i open or search in a virtual folder. i have  
enabled fts_lucene.

My config is:

# dovecot -n
# 2.3.devel (393bfbea8): /usr/local/etc/dovecot/dovecot.conf
# Pigeonhole version 0.5.0.rc1 (d68c23a1)
# OS: Linux 4.13.0-trunk-amd64 x86_64 Debian 9.3 btrfs
auth_mechanisms = plain login cram-md5 digest-md5
auth_socket_path = /usr/local/var/run/dovecot/auth-userdb
first_valid_uid = 1000
imap_capability = +XDOVECOT
imap_client_workarounds = tb-extra-mailbox-sep
lda_mailbox_autocreate = yes
lda_mailbox_autosubscribe = yes
listen = *, ::1
login_trusted_networks = 127.0.0.1/8 192.168.0.0/24 192.168.1.0/24  
172.17.0.0/24 172.18.0.0/24
mail_gid = vmail
mail_home =  /var/mail/%u
mail_location =  
maildir:/var/mail/%u/Maildir:LAYOUT=fs:INDEX=/var/lib/dovecot/db/indexes/Maildir/%u:INDEXPVT=/var/lib/dovecot/db/indexes/Maildir/%u:CONTROL=/var/lib/dovecot/db/control/Maildir/%u
mail_plugins = zlib quota acl listescape mail_log notify virtual fts  
fts_lucene
mail_privileged_group = vmail
mail_server_admin = mailto:[hidden email]
mail_shared_explicit_inbox = yes
mail_uid = vmail
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope  
encoded-character vacation subaddress comparator-i;ascii-numeric  
relational regex imap4flags copy include variables body enotify  
environment mailbox date index ihave duplicate mime foreverypart  
extracttext
namespace {
   list = children
   location =  
maildir:/var/mail/public/:LAYOUT=fs:INDEX=/var/lib/dovecot/db/indexes/public/%u:INDEXPVT=/var/lib/dovecot/db/indexes/public/%u
   prefix = Roseggergasse/
   separator = /
   subscriptions = no
   type = public
}
namespace Geteilt {
   hidden = no
   inbox = no
   list = children
   location =  
maildir:/var/mail/%%u/Maildir:LAYOUT=fs:INDEXPVT=/var/lib/dovecot/db/indexes/shared/%u/%%u:INDEX=/var/lib/dovecot/db/indexes/shared/%u/%%u
   prefix = Geteilt/%%n/
   separator = /
   subscriptions = no
   type = shared
}
namespace Mailarchiv {
   hidden = no
   inbox = no
   list = children
   location =  
maildir:/var/mail/mailarchiv/%u/:LAYOUT=fs:INDEX=/var/lib/dovecot/db/indexes/mailarchiv/%u:INDEXPVT=/var/lib/dovecot/db/indexes/mailarchiv/%u
   mailbox incoming {
     auto = create
   }
   mailbox outgoing {
     auto = create
   }
   prefix = Mailarchiv/
   separator = /
   subscriptions = no
   type = private
}
namespace Real {
   hidden = yes
   list = no
   location = virtual:/var/mail/real:INDEX=/var/lib/dovecot/db/indexes/real/%u
   prefix = Real/
   separator = /
   subscriptions = no
}
namespace Synoptic {
   hidden = no
   list = children
   location =  
virtual:/var/mail/virtual:INDEX=/var/lib/dovecot/db/indexes/virtual/%u
   mailbox INBOX/Archives {
     auto = no
     special_use = \Archive
   }
   mailbox INBOX/Drafts {
     auto = no
     special_use = \Drafts
   }
   mailbox INBOX/Entwürfe {
     auto = no
     special_use = \Drafts
   }
   mailbox INBOX/Junk {
     auto = no
     special_use = \Junk
   }
   mailbox INBOX/Sent {
     auto = no
     special_use = \Sent
   }
   mailbox INBOX/Spam {
     auto = no
     special_use = \Junk
   }
   prefix = Synoptic/
   separator = /
   subscriptions = no
}
namespace inbox {
   hidden = no
   inbox = yes
   location =
   mailbox Archiv {
     auto = no
     special_use = \Archive
   }
   mailbox Archive {
     auto = no
     special_use = \Archive
   }
   mailbox Archives {
     auto = no
     special_use = \Archive
   }
   mailbox "Deleted Messages" {
     auto = no
     autoexpunge = 30 days
     special_use = \Trash
   }
   mailbox Drafts {
     auto = no
     special_use = \Drafts
   }
   mailbox Entwürfe {
     auto = no
     special_use = \Drafts
   }
   mailbox "Gelöschte Elemente" {
     auto = no
     autoexpunge = 30 days
     special_use = \Trash
   }
   mailbox "Gelöschte Objekte" {
     auto = no
     autoexpunge = 30 days
     special_use = \Trash
   }
   mailbox Gesendet {
     auto = no
     special_use = \Sent
   }
   mailbox "Gesendete Elemente" {
     auto = no
     special_use = \Sent
   }
   mailbox "Gesendete Objekte" {
     auto = no
     special_use = \Sent
   }
   mailbox Important {
     auto = no
   }
   mailbox Junk {
     auto = subscribe
     autoexpunge = 30 days
     special_use = \Junk
   }
   mailbox Mistkübel {
     auto = no
     autoexpunge = 30 days
     special_use = \Trash
   }
   mailbox Papierkorb {
     auto = no
     autoexpunge = 30 days
     special_use = \Trash
   }
   mailbox Sent {
     auto = subscribe
     special_use = \Sent
   }
   mailbox "Sent Messages" {
     auto = no
     special_use = \Sent
   }
   mailbox Spam {
     auto = no
     autoexpunge = 30 days
     special_use = \Junk
   }
   mailbox Synoptic/Alle {
     auto = no
     comment = All my messages
     special_use = \All
   }
   mailbox Trash {
     auto = no
     autoexpunge = 30 days
     special_use = \Trash
   }
   mailbox Wichtig {
     auto = create
   }
   prefix = INBOX/
   separator = /
   subscriptions = no
   type = private
}
namespace subscriptions {
   hidden = yes
   list = no
   location =
   prefix =
   subscriptions = yes
}
passdb {
   args = scheme=CRYPT username_format=%u /usr/local/etc/dovecot/users
   driver = passwd-file
}
plugin {
   acl = vfile:/etc/dovecot/dovecot-acl:cache_secs=300
   acl_shared_dict = file:/var/lib/dovecot/db/shared-mailboxes.db
   fts = lucene
   fts_autoindex = yes
   fts_autoindex_max_recent_msgs = 80
   fts_index_timeout = 90s
   fts_lucene = whitespace_chars=@. normalize no_snowball
   mail_home =  /var/mail/%u
   setting_name = sieve, managedsieve
   sieve = file:/var/mail/%u/sieve/;active=/var/mail/%u/sieve/%u.sieve
}
postmaster_address = postmaster@localhost
protocols = imap pop3 lmtp imap lmtp sieve pop3 sieve
service anvil {
   unix_listener anvil-auth-penalty {
     mode = 00
   }
}
service auth {
   unix_listener auth-client {
     group = vmail
     mode = 0666
     user = Debian-exim
   }
   unix_listener auth-userdb {
     group = vmail
     mode = 0666
     user = vmail
   }
}
service imap-login {
   inet_listener imap {
     port = 143
   }
   inet_listener imaps {
     port = 993
     ssl = yes
   }
   process_min_avail = 1
   service_count = 0
}
service imap {
   executable = imap postlogin
   process_limit = 1024
   vsz_limit = 400 M
}
service lmtp {
   executable = lmtp -L
   user = vmail
   vsz_limit = 400 M
}
service postlogin {
   executable = script-login -d rawlog
}
ssl = required
ssl_cert = </usr/local/etc/dovecot/dovecot.crt
ssl_dh =  # hidden, use -P to show it
ssl_key =  # hidden, use -P to show it
userdb {
   args = username_format=%u /usr/local/etc/dovecot/users
   default_fields = home=/var/mail/%u
   driver = passwd-file
}
verbose_proctitle = yes
protocol lmtp {
   auth_username_format = %n
   mail_plugins = zlib quota acl listescape mail_log notify virtual  
fts fts_lucene quota sieve acl
}
protocol lda {
   mail_plugins = zlib quota acl listescape mail_log notify virtual  
fts fts_lucene quota sieve acl
}
protocol imap {
   mail_max_userip_connections = 10
   mail_plugins = zlib quota acl listescape mail_log notify virtual  
fts fts_lucene imap_quota imap_acl
}


The virtual Folder-definitions are:

# find /var/mail/virtual/ /var/mail/real/
/var/mail/virtual/
/var/mail/virtual/GINBOX
/var/mail/virtual/GINBOX/dovecot-virtual
/var/mail/virtual/Neue
/var/mail/virtual/Neue/dovecot-virtual
/var/mail/virtual/Markierte
/var/mail/virtual/Markierte/dovecot-virtual
/var/mail/virtual/Ungelesene
/var/mail/virtual/Ungelesene/dovecot-virtual
/var/mail/virtual/Sent
/var/mail/virtual/Sent/dovecot-virtual
/var/mail/virtual/Drafts
/var/mail/virtual/Drafts/dovecot-virtual
/var/mail/virtual/Trash
/var/mail/virtual/Trash/dovecot-virtual
/var/mail/virtual/AKTUELL
/var/mail/virtual/AKTUELL/dovecot-virtual
/var/mail/virtual/Archives
/var/mail/virtual/Archives/dovecot-virtual
/var/mail/virtual/dovecot-acl-list
/var/mail/virtual/WICHTIG
/var/mail/virtual/WICHTIG/dovecot-virtual
/var/mail/real/
/var/mail/real/Alle
/var/mail/real/Alle/dovecot-virtual
/var/mail/real/dovecot-acl-list
/var/mail/real/einjahr
/var/mail/real/einjahr/dovecot-virtual
/var/mail/real/zweijahr
/var/mail/real/zweijahr/dovecot-virtual
/var/mail/real/dreijahr
/var/mail/real/dreijahr/dovecot-virtual

# cat /var/mail/virtual/AKTUELL/dovecot-virtual
Real/Alle
  inthread refs younger 2592000

  # cat /var/mail/real/Alle/dovecot-virtual
!INBOX
INBOX/*
-INBOX/Trash
-INBOX/Trash/*
-INBOX/Archives
-INBOX/Archives/*
-INBOX/Drafts
-INBOX/Drafts/*
-INBOX/Junk
-INBOX/Junk/*
-INBOX/SYSTEM
-INBOX/SYSTEM/*
  all

The others are similar.

Greez

Jakob
Reply | Threaded
Open this post in threaded view
|

Re: Bug in dovecot 2.3 virtual plugin

Aki Tuomi-2
This is not a bug in virtual plugin, but in some email which contains invalid unicode sequence somehow. Can you send me a core file? This should not have occured ofc but would be nice to know how it ended up here.

Aki

> On January 3, 2018 at 5:35 PM Jakobus Schürz <[hidden email]> wrote:
>
>
> Hi there!
>
> I compiled dovecot 2.3 from git. Because there is already a bug in  
> virtual-plugin, and i hoped, it get fixed... but it doesn't. So this  
> is the error-message from the log
>
> Jän 03 16:27:08 aldebaran dovecot[26460]:  
> indexer-worker(jakob)<26476><qQ6g1+BhIJvAqAAO:sjYhMTH2TFpsZwAAk1Mx3g>:  
> Panic: file unichar.c: line 160 (uni_ucs4_to_utf8_c): assertion  
> failed: (uni_is_valid_ucs4(chr))
> Jän 03 16:27:08 aldebaran dovecot[26460]:  
> indexer-worker(jakob)<26476><qQ6g1+BhIJvAqAAO:sjYhMTH2TFpsZwAAk1Mx3g>:  
> Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0xc6021)  
> [0x7f8299f7a021] -> /usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed)  
> [0x7f8299f7a0ed] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0)  
> [0x7f8299eec481] ->  
> /usr/local/lib/dovecot/libdovecot.so.0(uni_ucs4_to_utf8_c+0xa0)  
> [0x7f8299fb1500] -> /usr/local/lib/dovecot/libdovecot.so.0(+0xa75e0)  
> [0x7f8299f5b5e0] ->  
> /usr/local/lib/dovecot/libdovecot.so.0(mail_html2text_more+0xc5)  
> [0x7f8299f5b775] ->  
> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0xcfcc) [0x7f82990aefcc]  
> -> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_parser_more+0x27)  
> [0x7f82990aeca7] ->  
> /usr/local/lib/dovecot/lib20_fts_plugin.so(fts_build_mail+0x5e9)  
> [0x7f82990acc39] ->  
> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x1122d) [0x7f82990b322d]  
> -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x916a)  
> [0x7f82958e316a] ->  
> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10f5d) [0x7f82990b2f5d]  
> -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x916a)  
> [0x7f82958e316a] ->  
> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x10f5d) [0x7f82990b2f5d]  
> -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_precache+0x2e)  
> [0x7f829a2641be] -> dovecot/indexer-worker [jakob  
> Synoptic/AKTUELL](+0x2533) [0x562227882533] ->  
> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69)  
> [0x7f8299f91bf9] ->  
> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109)  
> [0x7f8299f93499] ->  
> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52)  
> [0x7f8299f91d02] ->  
> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38)  
> [0x7f8299f91f18] ->  
> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13)  
> [0x7f8299f0f1e3] -> dovecot/indexer-worker [jakob  
> Synoptic/AKTUELL](main+0xe7) [0x562227881f47] ->  
> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1)  
> [0x7f8299b352b1] -> dovecot/indexer-worker [jakob  
> Synoptic/AKTUELL](_start+0x2a) [0x56222788201a]
> Jän 03 16:27:08 aldebaran dovecot[26460]: indexer: Error: Indexer  
> worker disconnected, discarding 1 requests for jakob
> Jän 03 16:27:08 aldebaran dovecot[26460]:  
> imap(jakob)<26472><qQ6g1+BhIJvAqAAO>: Error: indexer failed to index  
> mailbox Synoptic/AKTUELL
> Jän 03 16:27:08 aldebaran dovecot[26460]:  
> indexer-worker(jakob)<26476><qQ6g1+BhIJvAqAAO:sjYhMTH2TFpsZwAAk1Mx3g>:  
> Fatal: master: service(indexer-worker): child 26476 killed with signal  
> 6 (core dumps disabled)
> Jän 03 16:27:09 aldebaran dovecot[26460]:  
> indexer-worker(jakob)<26484><qQ6g1+BhIJvAqAAO:J6mUIEz2TFp0ZwAAk1Mx3g>:  
> Error: lucene index  
> /var/lib/dovecot/db/indexes/Maildir/jakob/lucene-indexes:  
> IndexWriter() failed (#1): Lock obtain timed out
> Jän 03 16:27:10 aldebaran dovecot[26460]:  
> indexer-worker(jakob)<26484><qQ6g1+BhIJvAqAAO:J6mUIEz2TFp0ZwAAk1Mx3g>:  
> Error: Mailbox Synoptic/AKTUELL: Transaction commit failed: BUG:  
> Unknown internal error (attempted to index 1488 messages (UIDs  
> 15214..16775))
> Jän 03 16:27:10 aldebaran dovecot[26460]:  
> imap(jakob)<26480><lP5r2OBhKJvAqAAO>: Error: indexer failed to index  
> mailbox Synoptic/AKTUELL
> Jän 03 16:27:11 aldebaran dovecot[26460]:  
> imap(jakob)<26472><qQ6g1+BhIJvAqAAO>: Panic: file mail-index.c: line  
> 793 (mail_index_close): assertion failed: (index->open_count > 0)
> Jän 03 16:27:11 aldebaran dovecot[26460]:  
> imap(jakob)<26472><qQ6g1+BhIJvAqAAO>: Error: Raw backtrace:  
> /usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7fb0fbd3a021] ->  
> /usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7fb0fbd3a0ed] ->  
> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fb0fbcac481] ->  
> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf39a8)  
> [0x7fb0fc0d99a8] ->  
> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd92d1)  
> [0x7fb0fc0bf2d1] ->  
> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd9363)  
> [0x7fb0fc0bf363] ->  
> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_free+0x9)  
> [0x7fb0fc0b0f39] ->  
> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd05a4)  
> [0x7fb0fc0b65a4] ->  
> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_free+0x19)  
> [0x7fb0fc030c99] ->  
> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xabdc)  
> [0x7fb0f729bbdc] ->  
> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xacb9)  
> [0x7fb0f729bcb9] ->  
> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a)  
> [0x7fb0fc030c0a] ->  
> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xac60)  
> [0x7fb0f729bc60] ->  
> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xacb9)  
> [0x7fb0f729bcb9] ->  
> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a)  
> [0x7fb0fc030c0a] ->  
> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_free+0x13)  
> [0x7fb0fc030c93] -> dovecot/imap [jakob 192.168.0.14  
> LOGOUT](imap_client_close_mailbox+0x5b) [0x56514d31305b] ->  
> dovecot/imap [jakob 192.168.0.14 LOGOUT](cmd_logout+0x35)  
> [0x56514d309485] -> dovecot/imap [jakob 192.168.0.14  
> LOGOUT](command_exec+0x64) [0x56514d312ca4] -> dovecot/imap [jakob  
> 192.168.0.14 LOGOUT](+0x1b0b2) [0x56514d3110b2] -> dovecot/imap [jakob  
> 192.168.0.14 LOGOUT](+0x1b13c) [0x56514d31113c] -> dovecot/imap [jakob  
> 192.168.0.14 LOGOUT](client_handle_input+0x1a5) [0x56514d311565] ->  
> dovecot/imap [jakob 192.168.0.14 LOGOUT](client_input+0x82)  
> [0x56514d311be2] ->  
> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69)  
> [0x7fb0fbd51bf9] ->  
> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109)  
> [0x7fb0fbd53499] ->  
> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52)  
> [0x7fb0fbd51d02] ->  
> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38)  
> [0x7fb0fbd51f18] ->  
> /usr/local/lib/dovecot/libdovecot.so.0(master_service_run+0x13)  
> [0x7fb0fbccf1e3]
> Jän 03 16:27:11 aldebaran dovecot[26460]:  
> imap(jakob)<26472><qQ6g1+BhIJvAqAAO>: Fatal: master: service(imap):  
> child 26472 killed with signal 6 (core dumps disabled)
>
>
> I get this errors when i open or search in a virtual folder. i have  
> enabled fts_lucene.
>
> My config is:
>
> # dovecot -n
> # 2.3.devel (393bfbea8): /usr/local/etc/dovecot/dovecot.conf
> # Pigeonhole version 0.5.0.rc1 (d68c23a1)
> # OS: Linux 4.13.0-trunk-amd64 x86_64 Debian 9.3 btrfs
> auth_mechanisms = plain login cram-md5 digest-md5
> auth_socket_path = /usr/local/var/run/dovecot/auth-userdb
> first_valid_uid = 1000
> imap_capability = +XDOVECOT
> imap_client_workarounds = tb-extra-mailbox-sep
> lda_mailbox_autocreate = yes
> lda_mailbox_autosubscribe = yes
> listen = *, ::1
> login_trusted_networks = 127.0.0.1/8 192.168.0.0/24 192.168.1.0/24  
> 172.17.0.0/24 172.18.0.0/24
> mail_gid = vmail
> mail_home =  /var/mail/%u
> mail_location =  
> maildir:/var/mail/%u/Maildir:LAYOUT=fs:INDEX=/var/lib/dovecot/db/indexes/Maildir/%u:INDEXPVT=/var/lib/dovecot/db/indexes/Maildir/%u:CONTROL=/var/lib/dovecot/db/control/Maildir/%u
> mail_plugins = zlib quota acl listescape mail_log notify virtual fts  
> fts_lucene
> mail_privileged_group = vmail
> mail_server_admin = mailto:[hidden email]
> mail_shared_explicit_inbox = yes
> mail_uid = vmail
> managesieve_notify_capability = mailto
> managesieve_sieve_capability = fileinto reject envelope  
> encoded-character vacation subaddress comparator-i;ascii-numeric  
> relational regex imap4flags copy include variables body enotify  
> environment mailbox date index ihave duplicate mime foreverypart  
> extracttext
> namespace {
>    list = children
>    location =  
> maildir:/var/mail/public/:LAYOUT=fs:INDEX=/var/lib/dovecot/db/indexes/public/%u:INDEXPVT=/var/lib/dovecot/db/indexes/public/%u
>    prefix = Roseggergasse/
>    separator = /
>    subscriptions = no
>    type = public
> }
> namespace Geteilt {
>    hidden = no
>    inbox = no
>    list = children
>    location =  
> maildir:/var/mail/%%u/Maildir:LAYOUT=fs:INDEXPVT=/var/lib/dovecot/db/indexes/shared/%u/%%u:INDEX=/var/lib/dovecot/db/indexes/shared/%u/%%u
>    prefix = Geteilt/%%n/
>    separator = /
>    subscriptions = no
>    type = shared
> }
> namespace Mailarchiv {
>    hidden = no
>    inbox = no
>    list = children
>    location =  
> maildir:/var/mail/mailarchiv/%u/:LAYOUT=fs:INDEX=/var/lib/dovecot/db/indexes/mailarchiv/%u:INDEXPVT=/var/lib/dovecot/db/indexes/mailarchiv/%u
>    mailbox incoming {
>      auto = create
>    }
>    mailbox outgoing {
>      auto = create
>    }
>    prefix = Mailarchiv/
>    separator = /
>    subscriptions = no
>    type = private
> }
> namespace Real {
>    hidden = yes
>    list = no
>    location = virtual:/var/mail/real:INDEX=/var/lib/dovecot/db/indexes/real/%u
>    prefix = Real/
>    separator = /
>    subscriptions = no
> }
> namespace Synoptic {
>    hidden = no
>    list = children
>    location =  
> virtual:/var/mail/virtual:INDEX=/var/lib/dovecot/db/indexes/virtual/%u
>    mailbox INBOX/Archives {
>      auto = no
>      special_use = \Archive
>    }
>    mailbox INBOX/Drafts {
>      auto = no
>      special_use = \Drafts
>    }
>    mailbox INBOX/Entwürfe {
>      auto = no
>      special_use = \Drafts
>    }
>    mailbox INBOX/Junk {
>      auto = no
>      special_use = \Junk
>    }
>    mailbox INBOX/Sent {
>      auto = no
>      special_use = \Sent
>    }
>    mailbox INBOX/Spam {
>      auto = no
>      special_use = \Junk
>    }
>    prefix = Synoptic/
>    separator = /
>    subscriptions = no
> }
> namespace inbox {
>    hidden = no
>    inbox = yes
>    location =
>    mailbox Archiv {
>      auto = no
>      special_use = \Archive
>    }
>    mailbox Archive {
>      auto = no
>      special_use = \Archive
>    }
>    mailbox Archives {
>      auto = no
>      special_use = \Archive
>    }
>    mailbox "Deleted Messages" {
>      auto = no
>      autoexpunge = 30 days
>      special_use = \Trash
>    }
>    mailbox Drafts {
>      auto = no
>      special_use = \Drafts
>    }
>    mailbox Entwürfe {
>      auto = no
>      special_use = \Drafts
>    }
>    mailbox "Gelöschte Elemente" {
>      auto = no
>      autoexpunge = 30 days
>      special_use = \Trash
>    }
>    mailbox "Gelöschte Objekte" {
>      auto = no
>      autoexpunge = 30 days
>      special_use = \Trash
>    }
>    mailbox Gesendet {
>      auto = no
>      special_use = \Sent
>    }
>    mailbox "Gesendete Elemente" {
>      auto = no
>      special_use = \Sent
>    }
>    mailbox "Gesendete Objekte" {
>      auto = no
>      special_use = \Sent
>    }
>    mailbox Important {
>      auto = no
>    }
>    mailbox Junk {
>      auto = subscribe
>      autoexpunge = 30 days
>      special_use = \Junk
>    }
>    mailbox Mistkübel {
>      auto = no
>      autoexpunge = 30 days
>      special_use = \Trash
>    }
>    mailbox Papierkorb {
>      auto = no
>      autoexpunge = 30 days
>      special_use = \Trash
>    }
>    mailbox Sent {
>      auto = subscribe
>      special_use = \Sent
>    }
>    mailbox "Sent Messages" {
>      auto = no
>      special_use = \Sent
>    }
>    mailbox Spam {
>      auto = no
>      autoexpunge = 30 days
>      special_use = \Junk
>    }
>    mailbox Synoptic/Alle {
>      auto = no
>      comment = All my messages
>      special_use = \All
>    }
>    mailbox Trash {
>      auto = no
>      autoexpunge = 30 days
>      special_use = \Trash
>    }
>    mailbox Wichtig {
>      auto = create
>    }
>    prefix = INBOX/
>    separator = /
>    subscriptions = no
>    type = private
> }
> namespace subscriptions {
>    hidden = yes
>    list = no
>    location =
>    prefix =
>    subscriptions = yes
> }
> passdb {
>    args = scheme=CRYPT username_format=%u /usr/local/etc/dovecot/users
>    driver = passwd-file
> }
> plugin {
>    acl = vfile:/etc/dovecot/dovecot-acl:cache_secs=300
>    acl_shared_dict = file:/var/lib/dovecot/db/shared-mailboxes.db
>    fts = lucene
>    fts_autoindex = yes
>    fts_autoindex_max_recent_msgs = 80
>    fts_index_timeout = 90s
>    fts_lucene = whitespace_chars=@. normalize no_snowball
>    mail_home =  /var/mail/%u
>    setting_name = sieve, managedsieve
>    sieve = file:/var/mail/%u/sieve/;active=/var/mail/%u/sieve/%u.sieve
> }
> postmaster_address = postmaster@localhost
> protocols = imap pop3 lmtp imap lmtp sieve pop3 sieve
> service anvil {
>    unix_listener anvil-auth-penalty {
>      mode = 00
>    }
> }
> service auth {
>    unix_listener auth-client {
>      group = vmail
>      mode = 0666
>      user = Debian-exim
>    }
>    unix_listener auth-userdb {
>      group = vmail
>      mode = 0666
>      user = vmail
>    }
> }
> service imap-login {
>    inet_listener imap {
>      port = 143
>    }
>    inet_listener imaps {
>      port = 993
>      ssl = yes
>    }
>    process_min_avail = 1
>    service_count = 0
> }
> service imap {
>    executable = imap postlogin
>    process_limit = 1024
>    vsz_limit = 400 M
> }
> service lmtp {
>    executable = lmtp -L
>    user = vmail
>    vsz_limit = 400 M
> }
> service postlogin {
>    executable = script-login -d rawlog
> }
> ssl = required
> ssl_cert = </usr/local/etc/dovecot/dovecot.crt
> ssl_dh =  # hidden, use -P to show it
> ssl_key =  # hidden, use -P to show it
> userdb {
>    args = username_format=%u /usr/local/etc/dovecot/users
>    default_fields = home=/var/mail/%u
>    driver = passwd-file
> }
> verbose_proctitle = yes
> protocol lmtp {
>    auth_username_format = %n
>    mail_plugins = zlib quota acl listescape mail_log notify virtual  
> fts fts_lucene quota sieve acl
> }
> protocol lda {
>    mail_plugins = zlib quota acl listescape mail_log notify virtual  
> fts fts_lucene quota sieve acl
> }
> protocol imap {
>    mail_max_userip_connections = 10
>    mail_plugins = zlib quota acl listescape mail_log notify virtual  
> fts fts_lucene imap_quota imap_acl
> }
>
>
> The virtual Folder-definitions are:
>
> # find /var/mail/virtual/ /var/mail/real/
> /var/mail/virtual/
> /var/mail/virtual/GINBOX
> /var/mail/virtual/GINBOX/dovecot-virtual
> /var/mail/virtual/Neue
> /var/mail/virtual/Neue/dovecot-virtual
> /var/mail/virtual/Markierte
> /var/mail/virtual/Markierte/dovecot-virtual
> /var/mail/virtual/Ungelesene
> /var/mail/virtual/Ungelesene/dovecot-virtual
> /var/mail/virtual/Sent
> /var/mail/virtual/Sent/dovecot-virtual
> /var/mail/virtual/Drafts
> /var/mail/virtual/Drafts/dovecot-virtual
> /var/mail/virtual/Trash
> /var/mail/virtual/Trash/dovecot-virtual
> /var/mail/virtual/AKTUELL
> /var/mail/virtual/AKTUELL/dovecot-virtual
> /var/mail/virtual/Archives
> /var/mail/virtual/Archives/dovecot-virtual
> /var/mail/virtual/dovecot-acl-list
> /var/mail/virtual/WICHTIG
> /var/mail/virtual/WICHTIG/dovecot-virtual
> /var/mail/real/
> /var/mail/real/Alle
> /var/mail/real/Alle/dovecot-virtual
> /var/mail/real/dovecot-acl-list
> /var/mail/real/einjahr
> /var/mail/real/einjahr/dovecot-virtual
> /var/mail/real/zweijahr
> /var/mail/real/zweijahr/dovecot-virtual
> /var/mail/real/dreijahr
> /var/mail/real/dreijahr/dovecot-virtual
>
> # cat /var/mail/virtual/AKTUELL/dovecot-virtual
> Real/Alle
>   inthread refs younger 2592000
>
>   # cat /var/mail/real/Alle/dovecot-virtual
> !INBOX
> INBOX/*
> -INBOX/Trash
> -INBOX/Trash/*
> -INBOX/Archives
> -INBOX/Archives/*
> -INBOX/Drafts
> -INBOX/Drafts/*
> -INBOX/Junk
> -INBOX/Junk/*
> -INBOX/SYSTEM
> -INBOX/SYSTEM/*
>   all
>
> The others are similar.
>
> Greez
>
> Jakob
Reply | Threaded
Open this post in threaded view
|

Re: Bug in dovecot 2.3 virtual plugin

Jakob Schürz
Hi!

Is this a bug according to the other one?

When i try to open a real or virtual mailbox, i often (not on every  
mailbox) get this error-message:

Jän 04 11:03:32 aldebaran dovecot[24534]:  
imap(jakob)<24705><Ug/EcfBhSrDAqAAO>: Panic: Leaked view for index  
/var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index: Opened  
in index-storage.c:336
Jän 04 11:03:32 aldebaran dovecot[24534]:  
imap(jakob)<24705><Ug/EcfBhSrDAqAAO>: Error: Raw backtrace:  
/usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7f47d5872021] ->  
/usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7f47d58720ed] ->  
/usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f47d57e4481] ->  
/usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf3942)  
[0x7f47d5c11942] ->  
/usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_close+0x72) [0x7f47d5be8ec2] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) [0x7f47d5b68c0a] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xa7e0) [0x7f47d0dd37e0] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b) [0x7f47d0dd397b] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x1026) [0x7f47d0dd6926] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d) [0x7f47d5b6b05d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7f47d5b6b117] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31) [0x7f47d5be7781] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9b3d) [0x7f47d0dd2b3d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xaded1) [0x7f47d5bcbed1] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xe975) [0x7f47d5001975] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31) [0x7f47d5b6b4b1] -> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x114d) [0x7f47d0dd6a4d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d) [0x7f47d5b6b05d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37) [0x7f47d5b6b117] -> dovecot/imap [jakob 192.168.0.14 EXAMINE](cmd_select_full+0x171) [0x555d195a91a1] -> dovecot/imap [jakob 192.168.0.14 EXAMINE](command_exec+0x64) [0x555d195b0ca4] -> dovecot/imap [jakob 192.168.0.14 EXAMINE](+0x1b0b2) [0x555d195af0b2] -> dovecot/imap [jakob 192.168.0.14 EXAMINE](+0x1b13c) [0x555d195af13c] -> dovecot/imap [jakob 192.168.0.14 EXAMINE](client_handle_input+0x1a5) [0x555d195af565] -> dovecot/imap [jakob 192.168.0.14 EXAMINE](client_input+0x82) [0x555d195afbe2] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7f47d5889bf9] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109) [0x7f47d588b499] -> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52)  
[0x7f47d5889d02]
Jän 04 11:03:32 aldebaran dovecot[24534]:  
imap(jakob)<24705><Ug/EcfBhSrDAqAAO>: Fatal: master: service(imap):  
child 24705 killed with signal 6 (core dumps disabled)

I deinstalled all debian-dovecot-packages and installed the user  
dovenull manually again. This is all, i did.

jakob
Reply | Threaded
Open this post in threaded view
|

Re: Bug in dovecot 2.3 virtual plugin

Jakob Schürz
Hi!

This is very strange...
This error affects only one mailaccount, and it happend not yesterday.
The file

/var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index

which hat "Panic: Leaked view for index" does not exist. only
dovecot.index.log and .cache exists in this mailbox. (which is normal
for small mailboxes, i've read). But why is dovecot throwing an error?

And i could find out, this is only, when i try to open a virtual folder.

I switched back to older self-compiled dovecot-versions... but the error
exists also there (but not before the update!!!)

I also deleted all the dovecot.index-files, dovecot.index.log and
dovecot.index.cache-files to let rebuild dovecot the index again... the
error persists.

Is it a misconfiguration?

So i tried to build for the virtual-Mailboxes the Index in memory... the
error persists and dovecot wants to read this index-file.

My virtual folders not working any longer (on this account only!)

For debug purpose i deleted all the emails in this mailbox, the error
dissapered on this folder, but comes back in the next folder.

could this be a problem with ulimit?

greez
jakob

Am 2018-01-04 um 11:07 schrieb Jakobus Schürz:

> Hi!
>
> Is this a bug according to the other one?
>
> When i try to open a real or virtual mailbox, i often (not on every
> mailbox) get this error-message:
>
> Jän 04 11:03:32 aldebaran dovecot[24534]:
> imap(jakob)<24705><Ug/EcfBhSrDAqAAO>: Panic: Leaked view for index
> /var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index: Opened in
> index-storage.c:336
> Jän 04 11:03:32 aldebaran dovecot[24534]:
> imap(jakob)<24705><Ug/EcfBhSrDAqAAO>: Error: Raw backtrace:
> /usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7f47d5872021] ->
> /usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7f47d58720ed] ->
> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f47d57e4481] ->
> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf3942)
> [0x7f47d5c11942] ->
> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_close+0x72)
> [0x7f47d5be8ec2] ->
> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a)
> [0x7f47d5b68c0a] ->
> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xa7e0) [0x7f47d0dd37e0]
> ->
> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b)
> [0x7f47d0dd397b] ->
> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x1026)
> [0x7f47d0dd6926] ->
> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d)
> [0x7f47d5b6b05d] ->
> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37)
> [0x7f47d5b6b117] ->
> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31)
> [0x7f47d5be7781] ->
> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9b3d) [0x7f47d0dd2b3d]
> -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xaded1)
> [0x7f47d5bcbed1] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xe975)
> [0x7f47d5001975] ->
> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31)
> [0x7f47d5b6b4b1] ->
> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x114d)
> [0x7f47d0dd6a4d] ->
> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d)
> [0x7f47d5b6b05d] ->
> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37)
> [0x7f47d5b6b117] -> dovecot/imap [jakob 192.168.0.14
> EXAMINE](cmd_select_full+0x171) [0x555d195a91a1] -> dovecot/imap [jakob
> 192.168.0.14 EXAMINE](command_exec+0x64) [0x555d195b0ca4] ->
> dovecot/imap [jakob 192.168.0.14 EXAMINE](+0x1b0b2) [0x555d195af0b2] ->
> dovecot/imap [jakob 192.168.0.14 EXAMINE](+0x1b13c) [0x555d195af13c] ->
> dovecot/imap [jakob 192.168.0.14 EXAMINE](client_handle_input+0x1a5)
> [0x555d195af565] -> dovecot/imap [jakob 192.168.0.14
> EXAMINE](client_input+0x82) [0x555d195afbe2] ->
> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69)
> [0x7f47d5889bf9] ->
> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109)
> [0x7f47d588b499] ->
> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52)
> [0x7f47d5889d02]
> Jän 04 11:03:32 aldebaran dovecot[24534]:
> imap(jakob)<24705><Ug/EcfBhSrDAqAAO>: Fatal: master: service(imap):
> child 24705 killed with signal 6 (core dumps disabled)
>
> I deinstalled all debian-dovecot-packages and installed the user
> dovenull manually again. This is all, i did.
>
> jakob


Reply | Threaded
Open this post in threaded view
|

Re: Bug in dovecot 2.3 virtual plugin

Jakobus Schürz
Good morning!

I did more research on this error.
The virtual mailboxes are working in two other accounts. The big
difference to my account is, i have a lot (sub)mailboxes (about 430) and
a lot emails in my account. The other accounts only have a few emails
and mailboxes (5 or 6 standard, inbox, trash, templates...)

So i moved all my mailboxes to another place  and left there only a few.
The virtual mailbox is working.
Then i put back some mailboxes, it is working.
Then i put back the next and the next and tried if the virtual mailbox
is reachable. it was working, and after i put back more then a half of
my mailboxes, the error occured again.
dovecot says:

Panic: Leaked view for index
/var/lib/dovecot/db/indexes/Maildir/jakob/TU-Wien/dovecot.index: Opened
in index-storage.c:336

The missing dovecot.indes file is now another. But it is on every
error-message the same missing indes-file.

Deleting the according mailbox, it gets another missing index-file. And
the every error-message stays on the next indes-file...

It looks to me, it'S a question about too many mailboxes, then an
internal index gets broken and can't rebuild on the every same point
(mailbox). This is just an idea, but i don't know how dovecot really
works...

I do not understand, why it worked till yesterday. And why it breaked on
deleting not used debian-packages... (maybe this is not the reason)

I removed all my virtual mailboxes from config


Am 04.01.2018 um 22:41 schrieb Jakob Schürz:

> Hi!
>
> This is very strange...
> This error affects only one mailaccount, and it happend not yesterday.
> The file
>
> /var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index
>
> which hat "Panic: Leaked view for index" does not exist. only
> dovecot.index.log and .cache exists in this mailbox. (which is normal
> for small mailboxes, i've read). But why is dovecot throwing an error?
>
> And i could find out, this is only, when i try to open a virtual folder.
>
> I switched back to older self-compiled dovecot-versions... but the error
> exists also there (but not before the update!!!)
>
> I also deleted all the dovecot.index-files, dovecot.index.log and
> dovecot.index.cache-files to let rebuild dovecot the index again... the
> error persists.
>
> Is it a misconfiguration?
>
> So i tried to build for the virtual-Mailboxes the Index in memory... the
> error persists and dovecot wants to read this index-file.
>
> My virtual folders not working any longer (on this account only!)
>
> For debug purpose i deleted all the emails in this mailbox, the error
> dissapered on this folder, but comes back in the next folder.
>
> could this be a problem with ulimit?
>
> greez
> jakob
>
> Am 2018-01-04 um 11:07 schrieb Jakobus Schürz:
>> Hi!
>>
>> Is this a bug according to the other one?
>>
>> When i try to open a real or virtual mailbox, i often (not on every
>> mailbox) get this error-message:
>>
>> Jän 04 11:03:32 aldebaran dovecot[24534]:
>> imap(jakob)<24705><Ug/EcfBhSrDAqAAO>: Panic: Leaked view for index
>> /var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index: Opened in
>> index-storage.c:336
>> Jän 04 11:03:32 aldebaran dovecot[24534]:
>> imap(jakob)<24705><Ug/EcfBhSrDAqAAO>: Error: Raw backtrace:
>> /usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7f47d5872021] ->
>> /usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7f47d58720ed] ->
>> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f47d57e4481] ->
>> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf3942)
>> [0x7f47d5c11942] ->
>> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_close+0x72)
>> [0x7f47d5be8ec2] ->
>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a)
>> [0x7f47d5b68c0a] ->
>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xa7e0) [0x7f47d0dd37e0]
>> ->
>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b)
>> [0x7f47d0dd397b] ->
>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x1026)
>> [0x7f47d0dd6926] ->
>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d)
>> [0x7f47d5b6b05d] ->
>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37)
>> [0x7f47d5b6b117] ->
>> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31)
>> [0x7f47d5be7781] ->
>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9b3d) [0x7f47d0dd2b3d]
>> -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xaded1)
>> [0x7f47d5bcbed1] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xe975)
>> [0x7f47d5001975] ->
>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31)
>> [0x7f47d5b6b4b1] ->
>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x114d)
>> [0x7f47d0dd6a4d] ->
>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d)
>> [0x7f47d5b6b05d] ->
>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37)
>> [0x7f47d5b6b117] -> dovecot/imap [jakob 192.168.0.14
>> EXAMINE](cmd_select_full+0x171) [0x555d195a91a1] -> dovecot/imap [jakob
>> 192.168.0.14 EXAMINE](command_exec+0x64) [0x555d195b0ca4] ->
>> dovecot/imap [jakob 192.168.0.14 EXAMINE](+0x1b0b2) [0x555d195af0b2] ->
>> dovecot/imap [jakob 192.168.0.14 EXAMINE](+0x1b13c) [0x555d195af13c] ->
>> dovecot/imap [jakob 192.168.0.14 EXAMINE](client_handle_input+0x1a5)
>> [0x555d195af565] -> dovecot/imap [jakob 192.168.0.14
>> EXAMINE](client_input+0x82) [0x555d195afbe2] ->
>> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69)
>> [0x7f47d5889bf9] ->
>> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109)
>> [0x7f47d588b499] ->
>> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52)
>> [0x7f47d5889d02]
>> Jän 04 11:03:32 aldebaran dovecot[24534]:
>> imap(jakob)<24705><Ug/EcfBhSrDAqAAO>: Fatal: master: service(imap):
>> child 24705 killed with signal 6 (core dumps disabled)
>>
>> I deinstalled all debian-dovecot-packages and installed the user
>> dovenull manually again. This is all, i did.
>>
>> jakob
>
>
Reply | Threaded
Open this post in threaded view
|

Re: Bug in dovecot 2.3 virtual plugin

Aki Tuomi-2
In reply to this post by Jakob Schürz
This is a different bug, and I suspect it might be caused by virtual
plugin. We'll look into it.

Aki

On 04.01.2018 23:41, Jakob Schürz wrote:

> Hi!
>
> This is very strange...
> This error affects only one mailaccount, and it happend not yesterday.
> The file
>
> /var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index
>
> which hat "Panic: Leaked view for index" does not exist. only
> dovecot.index.log and .cache exists in this mailbox. (which is normal
> for small mailboxes, i've read). But why is dovecot throwing an error?
>
> And i could find out, this is only, when i try to open a virtual folder.
>
> I switched back to older self-compiled dovecot-versions... but the error
> exists also there (but not before the update!!!)
>
> I also deleted all the dovecot.index-files, dovecot.index.log and
> dovecot.index.cache-files to let rebuild dovecot the index again... the
> error persists.
>
> Is it a misconfiguration?
>
> So i tried to build for the virtual-Mailboxes the Index in memory... the
> error persists and dovecot wants to read this index-file.
>
> My virtual folders not working any longer (on this account only!)
>
> For debug purpose i deleted all the emails in this mailbox, the error
> dissapered on this folder, but comes back in the next folder.
>
> could this be a problem with ulimit?
>
> greez
> jakob
>
> Am 2018-01-04 um 11:07 schrieb Jakobus Schürz:
>> Hi!
>>
>> Is this a bug according to the other one?
>>
>> When i try to open a real or virtual mailbox, i often (not on every
>> mailbox) get this error-message:
>>
>> Jän 04 11:03:32 aldebaran dovecot[24534]:
>> imap(jakob)<24705><Ug/EcfBhSrDAqAAO>: Panic: Leaked view for index
>> /var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index: Opened in
>> index-storage.c:336
>> Jän 04 11:03:32 aldebaran dovecot[24534]:
>> imap(jakob)<24705><Ug/EcfBhSrDAqAAO>: Error: Raw backtrace:
>> /usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7f47d5872021] ->
>> /usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7f47d58720ed] ->
>> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f47d57e4481] ->
>> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf3942)
>> [0x7f47d5c11942] ->
>> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_close+0x72)
>> [0x7f47d5be8ec2] ->
>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a)
>> [0x7f47d5b68c0a] ->
>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xa7e0) [0x7f47d0dd37e0]
>> ->
>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b)
>> [0x7f47d0dd397b] ->
>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x1026)
>> [0x7f47d0dd6926] ->
>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d)
>> [0x7f47d5b6b05d] ->
>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37)
>> [0x7f47d5b6b117] ->
>> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31)
>> [0x7f47d5be7781] ->
>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9b3d) [0x7f47d0dd2b3d]
>> -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xaded1)
>> [0x7f47d5bcbed1] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xe975)
>> [0x7f47d5001975] ->
>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31)
>> [0x7f47d5b6b4b1] ->
>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x114d)
>> [0x7f47d0dd6a4d] ->
>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d)
>> [0x7f47d5b6b05d] ->
>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37)
>> [0x7f47d5b6b117] -> dovecot/imap [jakob 192.168.0.14
>> EXAMINE](cmd_select_full+0x171) [0x555d195a91a1] -> dovecot/imap [jakob
>> 192.168.0.14 EXAMINE](command_exec+0x64) [0x555d195b0ca4] ->
>> dovecot/imap [jakob 192.168.0.14 EXAMINE](+0x1b0b2) [0x555d195af0b2] ->
>> dovecot/imap [jakob 192.168.0.14 EXAMINE](+0x1b13c) [0x555d195af13c] ->
>> dovecot/imap [jakob 192.168.0.14 EXAMINE](client_handle_input+0x1a5)
>> [0x555d195af565] -> dovecot/imap [jakob 192.168.0.14
>> EXAMINE](client_input+0x82) [0x555d195afbe2] ->
>> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69)
>> [0x7f47d5889bf9] ->
>> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109)
>> [0x7f47d588b499] ->
>> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52)
>> [0x7f47d5889d02]
>> Jän 04 11:03:32 aldebaran dovecot[24534]:
>> imap(jakob)<24705><Ug/EcfBhSrDAqAAO>: Fatal: master: service(imap):
>> child 24705 killed with signal 6 (core dumps disabled)
>>
>> I deinstalled all debian-dovecot-packages and installed the user
>> dovenull manually again. This is all, i did.
>>
>> jakob
>

Reply | Threaded
Open this post in threaded view
|

Re: Bug in dovecot 2.3 virtual plugin

Jakob Schürz
Ok!
So the subject for this bug is correct...

Do you need some configs and deeper descriptions from me?

I have two namespaces with virtual mailboxes:
The first "Real" is normally hidden. It's not hidden now for debug-purpose.

namespace Real {
   hidden = no
   ignore_on_failure = yes
   list = children
   location =
virtual:/var/mail/real:INDEX=/var/lib/dovecot/db/indexes/real/%u
   prefix = Real/
   separator = /
   subscriptions = no
}

namespace Synoptic {
   hidden = no
   ignore_on_failure = yes
   list = children
   location =
virtual:/var/mail/virtual:INDEX=/var/lib/dovecot/db/indexes/virtual/%u
   mailbox INBOX/Archives {
     auto = no
     special_use = \Archive
   }
   mailbox INBOX/Drafts {
     auto = no
     special_use = \Drafts
   }
   mailbox INBOX/Entwürfe {
     auto = no
     special_use = \Drafts
   }
   mailbox INBOX/Junk {
     auto = no
     special_use = \Junk
   }
   mailbox INBOX/Sent {
     auto = no
     special_use = \Sent
   }
   mailbox INBOX/Spam {
     auto = no
     special_use = \Junk
   }
   prefix = Synoptic/
   separator = /
   subscriptions = no
}

The "Real" namespace is to get a first filter for emails for all, the
last 1, 2 and 3 years:

Here is the virtual-mailbox-definition:

/var/mail/real: # tree
.
├── Alle
│   └── dovecot-virtual
├── dovecot-acl-list
├── dreijahr
│   └── dovecot-virtual
├── einjahr
│   └── dovecot-virtual
└── zweijahr
     └── dovecot-virtual

and the index-files
/var/lib/dovecot/db/indexes: # tree real/
real/
└── jakob
     ├── Alle
     │   └── dovecot.index.log
     ├── dovecot.list.index.log
     ├── dreijahr
     │   └── dovecot.index.log
     ├── einjahr
     │   └── dovecot.index.log
     └── zweijahr
         └── dovecot.index.log


/var/mail/real: # cat Alle/dovecot-virtual
!INBOX
INBOX/*
-INBOX/Trash
-INBOX/Trash/*
-INBOX/Archives
-INBOX/Archives/*
-INBOX/Drafts
-INBOX/Drafts/*
-INBOX/Junk
-INBOX/Junk/*
-INBOX/SYSTEM
-INBOX/SYSTEM/*
  all

/var/mail/real: # cat einjahr/dovecot-virtual
Real/Alle
  all younger 31536000

And the namespace Synoptic is the one, i can subscribe. It has as
Background the "Real"-namespace:

/var/mail/virtual: # tree
.
├── AKTUELL
│   └── dovecot-virtual
├── Archives
│   └── dovecot-virtual
├── dovecot-acl-list
├── Drafts
│   └── dovecot-virtual
├── GINBOX
│   └── dovecot-virtual
├── Markierte
│   └── dovecot-virtual
├── Neue
│   └── dovecot-virtual
├── Sent
│   └── dovecot-virtual
├── Trash
│   └── dovecot-virtual
├── Ungelesene
│   └── dovecot-virtual
└── WICHTIG
     └── dovecot-virtual

/var/mail/virtual: # cat AKTUELL/dovecot-virtual
Real/einjahr
  inthread refs younger 2592000

/var/mail/virtual: # cat Markierte/dovecot-virtual
Real/Alle
  flagged

The error only appears in a Mailbox from one of this two namespaces.
Every other mailboxes (public, private, shared) are working correct.
When i try to open a mailbox from one of this two namespaces, the error
below (Panic: Leaked view for index) is throwen

jakob


Am 05.01.2018 um 10:25 schrieb Aki Tuomi:

> This is a different bug, and I suspect it might be caused by virtual
> plugin. We'll look into it.
>
> Aki
>
> On 04.01.2018 23:41, Jakob Schürz wrote:
>> Hi!
>>
>> This is very strange...
>> This error affects only one mailaccount, and it happend not yesterday.
>> The file
>>
>> /var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index
>>
>> which hat "Panic: Leaked view for index" does not exist. only
>> dovecot.index.log and .cache exists in this mailbox. (which is normal
>> for small mailboxes, i've read). But why is dovecot throwing an error?
>>
>> And i could find out, this is only, when i try to open a virtual folder.
>>
>> I switched back to older self-compiled dovecot-versions... but the error
>> exists also there (but not before the update!!!)
>>
>> I also deleted all the dovecot.index-files, dovecot.index.log and
>> dovecot.index.cache-files to let rebuild dovecot the index again... the
>> error persists.
>>
>> Is it a misconfiguration?
>>
>> So i tried to build for the virtual-Mailboxes the Index in memory... the
>> error persists and dovecot wants to read this index-file.
>>
>> My virtual folders not working any longer (on this account only!)
>>
>> For debug purpose i deleted all the emails in this mailbox, the error
>> dissapered on this folder, but comes back in the next folder.
>>
>> could this be a problem with ulimit?
>>
>> greez
>> jakob
>>
>> Am 2018-01-04 um 11:07 schrieb Jakobus Schürz:
>>> Hi!
>>>
>>> Is this a bug according to the other one?
>>>
>>> When i try to open a real or virtual mailbox, i often (not on every
>>> mailbox) get this error-message:
>>>
>>> Jän 04 11:03:32 aldebaran dovecot[24534]:
>>> imap(jakob)<24705><Ug/EcfBhSrDAqAAO>: Panic: Leaked view for index
>>> /var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index: Opened in
>>> index-storage.c:336
>>> Jän 04 11:03:32 aldebaran dovecot[24534]:
>>> imap(jakob)<24705><Ug/EcfBhSrDAqAAO>: Error: Raw backtrace:
>>> /usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7f47d5872021] ->
>>> /usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7f47d58720ed] ->
>>> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f47d57e4481] ->
>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf3942)
>>> [0x7f47d5c11942] ->
>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_close+0x72)
>>> [0x7f47d5be8ec2] ->
>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a)
>>> [0x7f47d5b68c0a] ->
>>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xa7e0) [0x7f47d0dd37e0]
>>> ->
>>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b)
>>> [0x7f47d0dd397b] ->
>>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x1026)
>>> [0x7f47d0dd6926] ->
>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d)
>>> [0x7f47d5b6b05d] ->
>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37)
>>> [0x7f47d5b6b117] ->
>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31)
>>> [0x7f47d5be7781] ->
>>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9b3d) [0x7f47d0dd2b3d]
>>> -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xaded1)
>>> [0x7f47d5bcbed1] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xe975)
>>> [0x7f47d5001975] ->
>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31)
>>> [0x7f47d5b6b4b1] ->
>>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x114d)
>>> [0x7f47d0dd6a4d] ->
>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d)
>>> [0x7f47d5b6b05d] ->
>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37)
>>> [0x7f47d5b6b117] -> dovecot/imap [jakob 192.168.0.14
>>> EXAMINE](cmd_select_full+0x171) [0x555d195a91a1] -> dovecot/imap [jakob
>>> 192.168.0.14 EXAMINE](command_exec+0x64) [0x555d195b0ca4] ->
>>> dovecot/imap [jakob 192.168.0.14 EXAMINE](+0x1b0b2) [0x555d195af0b2] ->
>>> dovecot/imap [jakob 192.168.0.14 EXAMINE](+0x1b13c) [0x555d195af13c] ->
>>> dovecot/imap [jakob 192.168.0.14 EXAMINE](client_handle_input+0x1a5)
>>> [0x555d195af565] -> dovecot/imap [jakob 192.168.0.14
>>> EXAMINE](client_input+0x82) [0x555d195afbe2] ->
>>> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69)
>>> [0x7f47d5889bf9] ->
>>> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109)
>>> [0x7f47d588b499] ->
>>> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52)
>>> [0x7f47d5889d02]
>>> Jän 04 11:03:32 aldebaran dovecot[24534]:
>>> imap(jakob)<24705><Ug/EcfBhSrDAqAAO>: Fatal: master: service(imap):
>>> child 24705 killed with signal 6 (core dumps disabled)
>>>
>>> I deinstalled all debian-dovecot-packages and installed the user
>>> dovenull manually again. This is all, i did.
>>>
>>> jakob
>>
>
Reply | Threaded
Open this post in threaded view
|

Re: Bug in dovecot 2.3 virtual plugin

Aki Tuomi-2
Does it always happen with 2.2 and 2.3? I was not immediately able to
reproduce your problem.

Aki


On 05.01.2018 12:26, Jakobus Schürz wrote:

> Ok!
> So the subject for this bug is correct...
>
> Do you need some configs and deeper descriptions from me?
>
> I have two namespaces with virtual mailboxes:
> The first "Real" is normally hidden. It's not hidden now for
> debug-purpose.
>
> namespace Real {
>   hidden = no
>   ignore_on_failure = yes
>   list = children
>   location =
> virtual:/var/mail/real:INDEX=/var/lib/dovecot/db/indexes/real/%u
>   prefix = Real/
>   separator = /
>   subscriptions = no
> }
>
> namespace Synoptic {
>   hidden = no
>   ignore_on_failure = yes
>   list = children
>   location =
> virtual:/var/mail/virtual:INDEX=/var/lib/dovecot/db/indexes/virtual/%u
>   mailbox INBOX/Archives {
>     auto = no
>     special_use = \Archive
>   }
>   mailbox INBOX/Drafts {
>     auto = no
>     special_use = \Drafts
>   }
>   mailbox INBOX/Entwürfe {
>     auto = no
>     special_use = \Drafts
>   }
>   mailbox INBOX/Junk {
>     auto = no
>     special_use = \Junk
>   }
>   mailbox INBOX/Sent {
>     auto = no
>     special_use = \Sent
>   }
>   mailbox INBOX/Spam {
>     auto = no
>     special_use = \Junk
>   }
>   prefix = Synoptic/
>   separator = /
>   subscriptions = no
> }
>
> The "Real" namespace is to get a first filter for emails for all, the
> last 1, 2 and 3 years:
>
> Here is the virtual-mailbox-definition:
>
> /var/mail/real: # tree
> .
> ├── Alle
> │   └── dovecot-virtual
> ├── dovecot-acl-list
> ├── dreijahr
> │   └── dovecot-virtual
> ├── einjahr
> │   └── dovecot-virtual
> └── zweijahr
>     └── dovecot-virtual
>
> and the index-files
> /var/lib/dovecot/db/indexes: # tree real/
> real/
> └── jakob
>     ├── Alle
>     │   └── dovecot.index.log
>     ├── dovecot.list.index.log
>     ├── dreijahr
>     │   └── dovecot.index.log
>     ├── einjahr
>     │   └── dovecot.index.log
>     └── zweijahr
>         └── dovecot.index.log
>
>
> /var/mail/real: # cat Alle/dovecot-virtual
> !INBOX
> INBOX/*
> -INBOX/Trash
> -INBOX/Trash/*
> -INBOX/Archives
> -INBOX/Archives/*
> -INBOX/Drafts
> -INBOX/Drafts/*
> -INBOX/Junk
> -INBOX/Junk/*
> -INBOX/SYSTEM
> -INBOX/SYSTEM/*
>  all
>
> /var/mail/real: # cat einjahr/dovecot-virtual
> Real/Alle
>  all younger 31536000
>
> And the namespace Synoptic is the one, i can subscribe. It has as
> Background the "Real"-namespace:
>
> /var/mail/virtual: # tree
> .
> ├── AKTUELL
> │   └── dovecot-virtual
> ├── Archives
> │   └── dovecot-virtual
> ├── dovecot-acl-list
> ├── Drafts
> │   └── dovecot-virtual
> ├── GINBOX
> │   └── dovecot-virtual
> ├── Markierte
> │   └── dovecot-virtual
> ├── Neue
> │   └── dovecot-virtual
> ├── Sent
> │   └── dovecot-virtual
> ├── Trash
> │   └── dovecot-virtual
> ├── Ungelesene
> │   └── dovecot-virtual
> └── WICHTIG
>     └── dovecot-virtual
>
> /var/mail/virtual: # cat AKTUELL/dovecot-virtual
> Real/einjahr
>  inthread refs younger 2592000
>
> /var/mail/virtual: # cat Markierte/dovecot-virtual
> Real/Alle
>  flagged
>
> The error only appears in a Mailbox from one of this two namespaces.
> Every other mailboxes (public, private, shared) are working correct.
> When i try to open a mailbox from one of this two namespaces, the
> error below (Panic: Leaked view for index) is throwen
>
> jakob
>
>
> Am 05.01.2018 um 10:25 schrieb Aki Tuomi:
>> This is a different bug, and I suspect it might be caused by virtual
>> plugin. We'll look into it.
>>
>> Aki
>>
>> On 04.01.2018 23:41, Jakob Schürz wrote:
>>> Hi!
>>>
>>> This is very strange...
>>> This error affects only one mailaccount, and it happend not yesterday.
>>> The file
>>>
>>> /var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index
>>>
>>> which hat "Panic: Leaked view for index" does not exist. only
>>> dovecot.index.log and .cache exists in this mailbox. (which is normal
>>> for small mailboxes, i've read). But why is dovecot throwing an error?
>>>
>>> And i could find out, this is only, when i try to open a virtual
>>> folder.
>>>
>>> I switched back to older self-compiled dovecot-versions... but the
>>> error
>>> exists also there (but not before the update!!!)
>>>
>>> I also deleted all the dovecot.index-files, dovecot.index.log and
>>> dovecot.index.cache-files to let rebuild dovecot the index again... the
>>> error persists.
>>>
>>> Is it a misconfiguration?
>>>
>>> So i tried to build for the virtual-Mailboxes the Index in memory...
>>> the
>>> error persists and dovecot wants to read this index-file.
>>>
>>> My virtual folders not working any longer (on this account only!)
>>>
>>> For debug purpose i deleted all the emails in this mailbox, the error
>>> dissapered on this folder, but comes back in the next folder.
>>>
>>> could this be a problem with ulimit?
>>>
>>> greez
>>> jakob
>>>
>>> Am 2018-01-04 um 11:07 schrieb Jakobus Schürz:
>>>> Hi!
>>>>
>>>> Is this a bug according to the other one?
>>>>
>>>> When i try to open a real or virtual mailbox, i often (not on every
>>>> mailbox) get this error-message:
>>>>
>>>> Jän 04 11:03:32 aldebaran dovecot[24534]:
>>>> imap(jakob)<24705><Ug/EcfBhSrDAqAAO>: Panic: Leaked view for index
>>>> /var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index:
>>>> Opened in
>>>> index-storage.c:336
>>>> Jän 04 11:03:32 aldebaran dovecot[24534]:
>>>> imap(jakob)<24705><Ug/EcfBhSrDAqAAO>: Error: Raw backtrace:
>>>> /usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7f47d5872021] ->
>>>> /usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7f47d58720ed] ->
>>>> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f47d57e4481] ->
>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf3942)
>>>> [0x7f47d5c11942] ->
>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_close+0x72)
>>>>
>>>> [0x7f47d5be8ec2] ->
>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a)
>>>> [0x7f47d5b68c0a] ->
>>>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xa7e0)
>>>> [0x7f47d0dd37e0]
>>>> ->
>>>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b)
>>>>
>>>> [0x7f47d0dd397b] ->
>>>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x1026)
>>>>
>>>> [0x7f47d0dd6926] ->
>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d)
>>>> [0x7f47d5b6b05d] ->
>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37)
>>>> [0x7f47d5b6b117] ->
>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31)
>>>>
>>>> [0x7f47d5be7781] ->
>>>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9b3d)
>>>> [0x7f47d0dd2b3d]
>>>> -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xaded1)
>>>> [0x7f47d5bcbed1] ->
>>>> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xe975)
>>>> [0x7f47d5001975] ->
>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31)
>>>>
>>>> [0x7f47d5b6b4b1] ->
>>>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x114d)
>>>>
>>>> [0x7f47d0dd6a4d] ->
>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d)
>>>> [0x7f47d5b6b05d] ->
>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37)
>>>> [0x7f47d5b6b117] -> dovecot/imap [jakob 192.168.0.14
>>>> EXAMINE](cmd_select_full+0x171) [0x555d195a91a1] -> dovecot/imap
>>>> [jakob
>>>> 192.168.0.14 EXAMINE](command_exec+0x64) [0x555d195b0ca4] ->
>>>> dovecot/imap [jakob 192.168.0.14 EXAMINE](+0x1b0b2)
>>>> [0x555d195af0b2] ->
>>>> dovecot/imap [jakob 192.168.0.14 EXAMINE](+0x1b13c)
>>>> [0x555d195af13c] ->
>>>> dovecot/imap [jakob 192.168.0.14 EXAMINE](client_handle_input+0x1a5)
>>>> [0x555d195af565] -> dovecot/imap [jakob 192.168.0.14
>>>> EXAMINE](client_input+0x82) [0x555d195afbe2] ->
>>>> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69)
>>>> [0x7f47d5889bf9] ->
>>>> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109)
>>>>
>>>> [0x7f47d588b499] ->
>>>> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52)
>>>> [0x7f47d5889d02]
>>>> Jän 04 11:03:32 aldebaran dovecot[24534]:
>>>> imap(jakob)<24705><Ug/EcfBhSrDAqAAO>: Fatal: master: service(imap):
>>>> child 24705 killed with signal 6 (core dumps disabled)
>>>>
>>>> I deinstalled all debian-dovecot-packages and installed the user
>>>> dovenull manually again. This is all, i did.
>>>>
>>>> jakob
>>>
>>

Reply | Threaded
Open this post in threaded view
|

Re: Bug in dovecot 2.3 virtual plugin

Jakob Schürz
In reply to this post by Aki Tuomi-2


Am 05.01.2018 um 10:25 schrieb Aki Tuomi:
> This is a different bug, and I suspect it might be caused by virtual
> plugin. We'll look into it.
>
> Aki

Ok!
So the subject for this bug is (now) correct...

I found out, that the count of mailboxes is not the problem. But the
count of emails!!
So i deletet all my mailboxes an created them new with doveadm.
430 empty mailboxes existed then. No problem with my virtual boxes.
Then i restored my emails mailbox for mailbox from backup.
After each restored mailbox i tested the virtual mailboxes.

It worked with 15482 emails.
Then i restored a larger one.  The total amount of emails was then
16843, and the virtual mailbox crashed like before.
Then i deleted the emails from the box... all is working.
I added them again, deletet 200, all is working.
deleted all of them again and added them again... so they are again
16844 (one email arrived in another mailbox), all is working. :-/

Put more and more emails to my mailboxes... checking every time if
virtual mailboxes are working, so i get a new error:

Jän 05 14:28:18 aldebaran dovecot[17022]:
imap(jakob)<5117><S0pzWAdiE/hcPAkS>: Panic: file mail-index.c: line 793
(mail_index_close): assertion failed: (index->open_count > 0)
Jän 05 14:28:18 aldebaran dovecot[17022]:
imap(jakob)<5117><S0pzWAdiE/hcPAkS>: Error: Raw backtrace:
/usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7f419fecd021] ->
/usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7f419fecd0ed] ->
/usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f419fe3f481] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf39a8)
[0x7f41a026c9a8] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd92d1)
[0x7f41a02522d1] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd9363)
[0x7f41a0252363] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_free+0x9)
[0x7f41a0243f39] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd05a4)
[0x7f41a02495a4] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_free+0x19)
[0x7f41a01c3c99] ->
/usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xabdc) [0x7f419b42ebdc]
-> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xacb9)
[0x7f419b42ecb9] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a)
[0x7f41a01c3c0a] ->
/usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xac60) [0x7f419b42ec60]
-> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xacb9)
[0x7f419b42ecb9] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a)
[0x7f41a01c3c0a] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_free+0x13)
[0x7f41a01c3c93] -> dovecot/imap [jakob 92.60.9.18
select](imap_client_close_mailbox+0x5b) [0x564c2088205b] -> dovecot/imap
[jakob 92.60.9.18 select](+0x14f03) [0x564c20879f03] -> dovecot/imap
[jakob 92.60.9.18 select](cmd_select_full+0xf9) [0x564c2087a129] ->
dovecot/imap [jakob 92.60.9.18 select](command_exec+0x64)
[0x564c20881ca4] -> dovecot/imap [jakob 92.60.9.18 select](+0x1b0b2)
[0x564c208800b2] -> dovecot/imap [jakob 92.60.9.18 select](+0x1b13c)
[0x564c2088013c] -> dovecot/imap [jakob 92.60.9.18
select](client_handle_input+0x1a5) [0x564c20880565] -> dovecot/imap
[jakob 92.60.9.18 select](client_input+0x82) [0x564c20880be2] ->
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69)
[0x7f419fee4c09] ->
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109)
[0x7f419fee64a9] ->
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52)
[0x7f419fee4d12] ->
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f419fee4f28]
Jän 05 14:28:18 aldebaran dovecot[17022]:
imap(jakob)<5117><S0pzWAdiE/hcPAkS>: Fatal: master: service(imap): child
5117 killed with signal 6 (core not dumped)



Do you need some configs and deeper descriptions from me?

I have two namespaces with virtual mailboxes:
The first "Real" is normally hidden. It's not hidden now for debug-purpose.

namespace Real {
   hidden = no
   ignore_on_failure = yes
   list = children
   location =
virtual:/var/mail/real:INDEX=/var/lib/dovecot/db/indexes/real/%u
   prefix = Real/
   separator = /
   subscriptions = no
}

namespace Synoptic {
   hidden = no
   ignore_on_failure = yes
   list = children
   location =
virtual:/var/mail/virtual:INDEX=/var/lib/dovecot/db/indexes/virtual/%u
   mailbox INBOX/Archives {
     auto = no
     special_use = \Archive
   }
   mailbox INBOX/Drafts {
     auto = no
     special_use = \Drafts
   }
   mailbox INBOX/Entwürfe {
     auto = no
     special_use = \Drafts
   }
   mailbox INBOX/Junk {
     auto = no
     special_use = \Junk
   }
   mailbox INBOX/Sent {
     auto = no
     special_use = \Sent
   }
   mailbox INBOX/Spam {
     auto = no
     special_use = \Junk
   }
   prefix = Synoptic/
   separator = /
   subscriptions = no
}

The "Real" namespace is to get a first filter for emails for all, the
last 1, 2 and 3 years:

Here is the virtual-mailbox-definition:

/var/mail/real: # tree
.
├── Alle
│   └── dovecot-virtual
├── dovecot-acl-list
├── dreijahr
│   └── dovecot-virtual
├── einjahr
│   └── dovecot-virtual
└── zweijahr
     └── dovecot-virtual

and the index-files
/var/lib/dovecot/db/indexes: # tree real/
real/
└── jakob
     ├── Alle
     │   └── dovecot.index.log
     ├── dovecot.list.index.log
     ├── dreijahr
     │   └── dovecot.index.log
     ├── einjahr
     │   └── dovecot.index.log
     └── zweijahr
         └── dovecot.index.log


/var/mail/real: # cat Alle/dovecot-virtual
!INBOX
INBOX/*
-INBOX/Trash
-INBOX/Trash/*
-INBOX/Archives
-INBOX/Archives/*
-INBOX/Drafts
-INBOX/Drafts/*
-INBOX/Junk
-INBOX/Junk/*
-INBOX/SYSTEM
-INBOX/SYSTEM/*
  all

/var/mail/real: # cat einjahr/dovecot-virtual
Real/Alle
  all younger 31536000

And the namespace Synoptic is the one, i can subscribe. It has as
Background the "Real"-namespace:

/var/mail/virtual: # tree
.
├── AKTUELL
│   └── dovecot-virtual
├── Archives
│   └── dovecot-virtual
├── dovecot-acl-list
├── Drafts
│   └── dovecot-virtual
├── GINBOX
│   └── dovecot-virtual
├── Markierte
│   └── dovecot-virtual
├── Neue
│   └── dovecot-virtual
├── Sent
│   └── dovecot-virtual
├── Trash
│   └── dovecot-virtual
├── Ungelesene
│   └── dovecot-virtual
└── WICHTIG
     └── dovecot-virtual

/var/mail/virtual: # cat AKTUELL/dovecot-virtual
Real/einjahr
  inthread refs younger 2592000

/var/mail/virtual: # cat Markierte/dovecot-virtual
Real/Alle
  flagged

The error only appears in a Mailbox from one of this two namespaces.
Every other mailboxes (public, private, shared) are working correct.
When i try to open a mailbox from one of this two namespaces, the error
below (Panic: Leaked view for index) is throwen

jakob


> On 04.01.2018 23:41, Jakob Schürz wrote:
>> Hi!
>>
>> This is very strange...
>> This error affects only one mailaccount, and it happend not yesterday.
>> The file
>>
>> /var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index
>>
>> which hat "Panic: Leaked view for index" does not exist. only
>> dovecot.index.log and .cache exists in this mailbox. (which is normal
>> for small mailboxes, i've read). But why is dovecot throwing an error?
>>
>> And i could find out, this is only, when i try to open a virtual folder.
>>
>> I switched back to older self-compiled dovecot-versions... but the error
>> exists also there (but not before the update!!!)
>>
>> I also deleted all the dovecot.index-files, dovecot.index.log and
>> dovecot.index.cache-files to let rebuild dovecot the index again... the
>> error persists.
>>
>> Is it a misconfiguration?
>>
>> So i tried to build for the virtual-Mailboxes the Index in memory... the
>> error persists and dovecot wants to read this index-file.
>>
>> My virtual folders not working any longer (on this account only!)
>>
>> For debug purpose i deleted all the emails in this mailbox, the error
>> dissapered on this folder, but comes back in the next folder.
>>
>> could this be a problem with ulimit?
>>
>> greez
>> jakob
>>
>> Am 2018-01-04 um 11:07 schrieb Jakobus Schürz:
>>> Hi!
>>>
>>> Is this a bug according to the other one?
>>>
>>> When i try to open a real or virtual mailbox, i often (not on every
>>> mailbox) get this error-message:
>>>
>>> Jän 04 11:03:32 aldebaran dovecot[24534]:
>>> imap(jakob)<24705><Ug/EcfBhSrDAqAAO>: Panic: Leaked view for index
>>> /var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index: Opened in
>>> index-storage.c:336
>>> Jän 04 11:03:32 aldebaran dovecot[24534]:
>>> imap(jakob)<24705><Ug/EcfBhSrDAqAAO>: Error: Raw backtrace:
>>> /usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7f47d5872021] ->
>>> /usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7f47d58720ed] ->
>>> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f47d57e4481] ->
>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf3942)
>>> [0x7f47d5c11942] ->
>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_close+0x72)
>>> [0x7f47d5be8ec2] ->
>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a)
>>> [0x7f47d5b68c0a] ->
>>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xa7e0) [0x7f47d0dd37e0]
>>> ->
>>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b)
>>> [0x7f47d0dd397b] ->
>>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x1026)
>>> [0x7f47d0dd6926] ->
>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d)
>>> [0x7f47d5b6b05d] ->
>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37)
>>> [0x7f47d5b6b117] ->
>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31)
>>> [0x7f47d5be7781] ->
>>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9b3d) [0x7f47d0dd2b3d]
>>> -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xaded1)
>>> [0x7f47d5bcbed1] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xe975)
>>> [0x7f47d5001975] ->
>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31)
>>> [0x7f47d5b6b4b1] ->
>>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x114d)
>>> [0x7f47d0dd6a4d] ->
>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d)
>>> [0x7f47d5b6b05d] ->
>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37)
>>> [0x7f47d5b6b117] -> dovecot/imap [jakob 192.168.0.14
>>> EXAMINE](cmd_select_full+0x171) [0x555d195a91a1] -> dovecot/imap [jakob
>>> 192.168.0.14 EXAMINE](command_exec+0x64) [0x555d195b0ca4] ->
>>> dovecot/imap [jakob 192.168.0.14 EXAMINE](+0x1b0b2) [0x555d195af0b2] ->
>>> dovecot/imap [jakob 192.168.0.14 EXAMINE](+0x1b13c) [0x555d195af13c] ->
>>> dovecot/imap [jakob 192.168.0.14 EXAMINE](client_handle_input+0x1a5)
>>> [0x555d195af565] -> dovecot/imap [jakob 192.168.0.14
>>> EXAMINE](client_input+0x82) [0x555d195afbe2] ->
>>> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69)
>>> [0x7f47d5889bf9] ->
>>> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109)
>>> [0x7f47d588b499] ->
>>> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52)
>>> [0x7f47d5889d02]
>>> Jän 04 11:03:32 aldebaran dovecot[24534]:
>>> imap(jakob)<24705><Ug/EcfBhSrDAqAAO>: Fatal: master: service(imap):
>>> child 24705 killed with signal 6 (core dumps disabled)
>>>
>>> I deinstalled all debian-dovecot-packages and installed the user
>>> dovenull manually again. This is all, i did.
>>>
>>> jakob


Reply | Threaded
Open this post in threaded view
|

Re: Bug in dovecot 2.3 virtual plugin

Jakob Schürz
In reply to this post by Aki Tuomi-2
So hello back again!


Am 05.01.2018 um 14:31 schrieb Jakobus Schürz:
>
>
> Am 05.01.2018 um 10:25 schrieb Aki Tuomi:
>> This is a different bug, and I suspect it might be caused by virtual
>> plugin. We'll look into it.
>>
>> Aki
>
>


It was a problem with selfhealing the index...
I deleted all my emails and mailboxes and rebuild the tree of mailboxes
again with doveadm.
Then i put back email for email from the cur-folders from backup to the
new-folders in the rebuild mailboxes. From the filename i cut of the
part with hostname and size and flags.

The archive now is in a separate namespace, because there are really a
lot of emails in.

Now it works great again (exept one error, i posted before)

Maybe you can find something to improve dovecot in selfhealing broken index.

Thanks for the great work on this server!

jakob
Reply | Threaded
Open this post in threaded view
|

Re: Bug in dovecot 2.3 virtual plugin

Jakob Schürz
In reply to this post by Aki Tuomi-2
Hi!

Now an error is back. I didn't change my configuration and get now this
error, whily i try to refresh my thunderbird. I think it happens in a
virtual folder again.


Jän 11 01:29:19 aldebaran dovecot[11597]: imap-login: Login:
user=<jakob>, method=CRAM-MD5, rip=127.0.0.1, lip=127.0.0.1, mpid=5008,
TLS, session=<+MAgPXVisrx/AAAB>
Jän 11 01:29:22 aldebaran dovecot[11597]:
imap(jakob)<5008><+MAgPXVisrx/AAAB>: Panic: file mail-index.c: line 793
(mail_index_close): assertion failed: (index->open_count > 0)
Jän 11 01:29:22 aldebaran dovecot[11597]:
imap(jakob)<5008><+MAgPXVisrx/AAAB>: Error: Raw backtrace:
/usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7fd17fbb9021] ->
/usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7fd17fbb90ed] ->
/usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fd17fb2b481] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf39a8)
[0x7fd17ff589a8] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd92d1)
[0x7fd17ff3e2d1] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd9363)
[0x7fd17ff3e363] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_free+0x9)
[0x7fd17ff2ff39] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd05a4)
[0x7fd17ff355a4] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_free+0x19)
[0x7fd17feafc99] ->
/usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xabdc) [0x7fd17b11abdc]
-> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xacb9)
[0x7fd17b11acb9] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a)
[0x7fd17feafc0a] ->
/usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xac60) [0x7fd17b11ac60]
-> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xacb9)
[0x7fd17b11acb9] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a)
[0x7fd17feafc0a] ->
/usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xac60) [0x7fd17b11ac60]
-> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xacb9)
[0x7fd17b11acb9] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a)
[0x7fd17feafc0a] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_free+0x13)
[0x7fd17feafc93] -> dovecot/imap [jakob 127.0.0.1
select](imap_client_close_mailbox+0x5b) [0x5633bdd9905b] -> dovecot/imap
[jakob 127.0.0.1 select](+0x14f03) [0x5633bdd90f03] -> dovecot/imap
[jakob 127.0.0.1 select](cmd_select_full+0xf9) [0x5633bdd91129] ->
dovecot/imap [jakob 127.0.0.1 select](command_exec+0x64)
[0x5633bdd98ca4] -> dovecot/imap [jakob 127.0.0.1 select](+0x1b0b2)
[0x5633bdd970b2] -> dovecot/imap [jakob 127.0.0.1 select](+0x1b13c)
[0x5633bdd9713c] -> dovecot/imap [jakob 127.0.0.1
select](client_handle_input+0x1a5) [0x5633bdd97565] -> dovecot/imap
[jakob 127.0.0.1 select](client_input+0x82) [0x5633bdd97be2] ->
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69)
[0x7fd17fbd0c09]
Jän 11 01:29:22 aldebaran dovecot[11597]:
imap(jakob)<5008><+MAgPXVisrx/AAAB>: Fatal: master: service(imap): child
5008 killed with signal 6 (core not dumped)


Am 2018-01-05 um 10:25 schrieb Aki Tuomi:

> This is a different bug, and I suspect it might be caused by virtual
> plugin. We'll look into it.
>
> Aki
>
> On 04.01.2018 23:41, Jakob Schürz wrote:
>> Hi!
>>
>> This is very strange...
>> This error affects only one mailaccount, and it happend not yesterday.
>> The file
>>
>> /var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index
>>
>> which hat "Panic: Leaked view for index" does not exist. only
>> dovecot.index.log and .cache exists in this mailbox. (which is normal
>> for small mailboxes, i've read). But why is dovecot throwing an error?
>>
>> And i could find out, this is only, when i try to open a virtual folder.
>>
>> I switched back to older self-compiled dovecot-versions... but the error
>> exists also there (but not before the update!!!)
>>
>> I also deleted all the dovecot.index-files, dovecot.index.log and
>> dovecot.index.cache-files to let rebuild dovecot the index again... the
>> error persists.
>>
>> Is it a misconfiguration?
>>
>> So i tried to build for the virtual-Mailboxes the Index in memory... the
>> error persists and dovecot wants to read this index-file.
>>
>> My virtual folders not working any longer (on this account only!)
>>
>> For debug purpose i deleted all the emails in this mailbox, the error
>> dissapered on this folder, but comes back in the next folder.
>>
>> could this be a problem with ulimit?
>>
>> greez
>> jakob
>>
>> Am 2018-01-04 um 11:07 schrieb Jakobus Schürz:
>>> Hi!
>>>
>>> Is this a bug according to the other one?
>>>
>>> When i try to open a real or virtual mailbox, i often (not on every
>>> mailbox) get this error-message:
>>>
>>> Jän 04 11:03:32 aldebaran dovecot[24534]:
>>> imap(jakob)<24705><Ug/EcfBhSrDAqAAO>: Panic: Leaked view for index
>>> /var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index: Opened in
>>> index-storage.c:336
>>> Jän 04 11:03:32 aldebaran dovecot[24534]:
>>> imap(jakob)<24705><Ug/EcfBhSrDAqAAO>: Error: Raw backtrace:
>>> /usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7f47d5872021] ->
>>> /usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7f47d58720ed] ->
>>> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f47d57e4481] ->
>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf3942)
>>> [0x7f47d5c11942] ->
>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_close+0x72)
>>> [0x7f47d5be8ec2] ->
>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a)
>>> [0x7f47d5b68c0a] ->
>>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xa7e0) [0x7f47d0dd37e0]
>>> ->
>>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b)
>>> [0x7f47d0dd397b] ->
>>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x1026)
>>> [0x7f47d0dd6926] ->
>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d)
>>> [0x7f47d5b6b05d] ->
>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37)
>>> [0x7f47d5b6b117] ->
>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31)
>>> [0x7f47d5be7781] ->
>>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9b3d) [0x7f47d0dd2b3d]
>>> -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xaded1)
>>> [0x7f47d5bcbed1] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xe975)
>>> [0x7f47d5001975] ->
>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31)
>>> [0x7f47d5b6b4b1] ->
>>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x114d)
>>> [0x7f47d0dd6a4d] ->
>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d)
>>> [0x7f47d5b6b05d] ->
>>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37)
>>> [0x7f47d5b6b117] -> dovecot/imap [jakob 192.168.0.14
>>> EXAMINE](cmd_select_full+0x171) [0x555d195a91a1] -> dovecot/imap [jakob
>>> 192.168.0.14 EXAMINE](command_exec+0x64) [0x555d195b0ca4] ->
>>> dovecot/imap [jakob 192.168.0.14 EXAMINE](+0x1b0b2) [0x555d195af0b2] ->
>>> dovecot/imap [jakob 192.168.0.14 EXAMINE](+0x1b13c) [0x555d195af13c] ->
>>> dovecot/imap [jakob 192.168.0.14 EXAMINE](client_handle_input+0x1a5)
>>> [0x555d195af565] -> dovecot/imap [jakob 192.168.0.14
>>> EXAMINE](client_input+0x82) [0x555d195afbe2] ->
>>> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69)
>>> [0x7f47d5889bf9] ->
>>> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109)
>>> [0x7f47d588b499] ->
>>> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52)
>>> [0x7f47d5889d02]
>>> Jän 04 11:03:32 aldebaran dovecot[24534]:
>>> imap(jakob)<24705><Ug/EcfBhSrDAqAAO>: Fatal: master: service(imap):
>>> child 24705 killed with signal 6 (core dumps disabled)
>>>
>>> I deinstalled all debian-dovecot-packages and installed the user
>>> dovenull manually again. This is all, i did.
>>>
>>> jakob
>>
>