When you choose to use the WYSIWYG editor (TinyMCE editor), the comment form you open will be in TinyMce mode, otherwise - in plain text mode.
Use WYSIWYG editor with comments: checked
Use WYSIWYG editor with comments: unchecked