Exactly when you should take down Christmas tree and decorations

It's a tradition that once Twelfth Night has been and gone, decorations should be packed away, but there's a fear that leaving it too late could bring misfortune.