No you don't have to log out ! One way to see your comments is to go to your account page by clicking on the 'my account' button at the top right hand row of buttons. When the 'account' page opens it is called ' My Hub Statistics' you will see a navigation block on the left of the page. Click on the 'comments' button and any 'comments' that you have not 'approved' will be shown.
You can then click on the Hub name to take you to the Hub to submit a reply!
One tip for you: Do not approve the 'comment' until after you have 'replied' to it!