Found another way to do it, too: Just like above, click on the Chatbox arrow, but instead of clicking on your last reply, click on First Unread Message, then do the rest as above.
Sorry for the picture sizes. The forum software said my pictures were too large, so I had to make them smaller.