BUG: Mailbox renaming algorithm got into a potentially infinite loop, aborting

[Dovecot mailing list]

Hi all!

I have two dovecot servers with dsync replication over tcp.
Replication works fine except for one user.

# doveadm replicator status
username                                                                                                 priority fast sync full sync success sync failed
[hidden email]                                                                            none     00:00:33  07:03:23  03:22:31     y

If i run dsync manually, i get the following error message:

dsync-local([hidden email]): Debug: brain M: -- Mailbox renamed, restart sync --
dsync-local([hidden email]): Error: BUG: Mailbox renaming algorithm got into a potentially infinite loop, aborting
dsync-local([hidden email]): Error: Mailbox INBOX.Foldername sync: mailbox_rename failed: Invalid mailbox name 'Foldername-temp-1': Missing namespace prefix 'INBOX.'

For more info see the attached sync_loop.log

Thanks for your help,

Alex

[Dovecot mailing list]

Hi all!

I'm using Dovecot 2.2.36.4.
Maybe someone can help, this bug makes the replication unusable for me.

Thanks,

Alex

On Wed, Sep 25, 2019 at 5:03 PM Alex Ha <[hidden email]> wrote:

Hi all!

I have two dovecot servers with dsync replication over tcp.
Replication works fine except for one user.

# doveadm replicator status
username                                                                                                 priority fast sync full sync success sync failed
[hidden email]                                                                            none     00:00:33  07:03:23  03:22:31     y

If i run dsync manually, i get the following error message:

dsync-local([hidden email]): Debug: brain M: -- Mailbox renamed, restart sync --
dsync-local([hidden email]): Error: BUG: Mailbox renaming algorithm got into a potentially infinite loop, aborting
dsync-local([hidden email]): Error: Mailbox INBOX.Foldername sync: mailbox_rename failed: Invalid mailbox name 'Foldername-temp-1': Missing namespace prefix 'INBOX.'

For more info see the attached sync_loop.log

Thanks for your help,

Alex

[Dovecot mailing list]

You could try fix this by manually renaming the problematic folder. This is a bug though.

Aki

On 15.10.2019 17.29, Alex Ha via dovecot wrote:

Hi all!

I'm using Dovecot 2.2.36.4.
Maybe someone can help, this bug makes the replication unusable for me.

Thanks,

Alex

On Wed, Sep 25, 2019 at 5:03 PM Alex Ha <[hidden email]> wrote:

Hi all!

I have two dovecot servers with dsync replication over tcp.
Replication works fine except for one user.

# doveadm replicator status
username                                                                                                 priority fast sync full sync success sync failed
[hidden email]                                                                            none     00:00:33  07:03:23  03:22:31     y

If i run dsync manually, i get the following error message:

dsync-local([hidden email]): Debug: brain M: -- Mailbox renamed, restart sync --
dsync-local([hidden email]): Error: BUG: Mailbox renaming algorithm got into a potentially infinite loop, aborting
dsync-local([hidden email]): Error: Mailbox INBOX.Foldername sync: mailbox_rename failed: Invalid mailbox name 'Foldername-temp-1': Missing namespace prefix 'INBOX.'

For more info see the attached sync_loop.log

Thanks for your help,

Alex

[Dovecot mailing list]

On 25 Sep 2019, at 17.03, Alex Ha via dovecot <[hidden email]> wrote:

Hi all!

I have two dovecot servers with dsync replication over tcp.
Replication works fine except for one user.

# doveadm replicator status
username                                                                                                 priority fast sync full sync success sync failed
[hidden email]                                                                            none     00:00:33  07:03:23  03:22:31     y

If i run dsync manually, i get the following error message:

dsync-local([hidden email]): Debug: brain M: -- Mailbox renamed, restart sync --
dsync-local([hidden email]): Error: BUG: Mailbox renaming algorithm got into a potentially infinite loop, aborting
dsync-local([hidden email]): Error: Mailbox INBOX.Foldername sync: mailbox_rename failed: Invalid mailbox name 'Foldername-temp-1': Missing namespace prefix 'INBOX.'

I've never fixed this because I haven't figured out how to reproduce it. If it happens with you all the time, could you try:

 - Get a copy of both replica sides, e.g. under /tmp/replica1 and /tmp/replica2

 - Make sure dsync still crashes with them, e.g. doveadm -o mail=maildir:/tmp/replica1 sync maildir:/tmp/replica2

 - Delete all mails and dovecot.index* files (but not dovecot.mailbox.log)

 - Make sure dsync still crashes

 - Send me the replicas - they should no longer contain anything sensitive

As for fixing, you could see if deleting dovecot.mailbox.log from both replicas happens to fix this.

[Dovecot mailing list]

On Wed, Oct 16, 2019 at 4:55 PM Timo Sirainen <[hidden email]> wrote:

On 25 Sep 2019, at 17.03, Alex Ha via dovecot <[hidden email]> wrote:

Hi all!

I have two dovecot servers with dsync replication over tcp.
Replication works fine except for one user.

# doveadm replicator status
username                                                                                                 priority fast sync full sync success sync failed
[hidden email]                                                                            none     00:00:33  07:03:23  03:22:31     y

If i run dsync manually, i get the following error message:

dsync-local([hidden email]): Debug: brain M: -- Mailbox renamed, restart sync --
dsync-local([hidden email]): Error: BUG: Mailbox renaming algorithm got into a potentially infinite loop, aborting
dsync-local([hidden email]): Error: Mailbox INBOX.Foldername sync: mailbox_rename failed: Invalid mailbox name 'Foldername-temp-1': Missing namespace prefix 'INBOX.'

I've never fixed this because I haven't figured out how to reproduce it. If it happens with you all the time, could you try:

 - Get a copy of both replica sides, e.g. under /tmp/replica1 and /tmp/replica2

 - Make sure dsync still crashes with them, e.g. doveadm -o mail=maildir:/tmp/replica1 sync maildir:/tmp/replica2

 - Delete all mails and dovecot.index* files (but not dovecot.mailbox.log)

 - Make sure dsync still crashes

 - Send me the replicas - they should no longer contain anything sensitive

As for fixing, you could see if deleting dovecot.mailbox.log from both replicas happens to fix this.

Unfortunatley deleting dovecot.mailbox.log on both replicas did not fix the problem.

Alex

[Dovecot mailing list]

On 17 Oct 2019, at 13.01, Alex Ha via dovecot <[hidden email]> wrote:

dsync-local([hidden email]): Error: BUG: Mailbox renaming algorithm got into a potentially infinite loop, aborting
dsync-local([hidden email]): Error: Mailbox INBOX.Foldername sync: mailbox_rename failed: Invalid mailbox name 'Foldername-temp-1': Missing namespace prefix 'INBOX.'

As for fixing, you could see if deleting dovecot.mailbox.log from both replicas happens to fix this.

Unfortunatley deleting dovecot.mailbox.log on both replicas did not fix the problem.

I could reproduce the issue. Looks like deleting both dovecot.mailbox.log* and dovecot.list.index* fixes it. Tracking this internally in DOP-1501.