Unfortunately, co-authoring option is not currently supported for password-protected files. Box have told me this is because the system considers the password protection as a lock.
Therefore bringing it your attention to add this feature request.

Also we are finding that co-authoring takes a lot long to open files and it is not as smooth as its made out to be.