Go to the blog click Options -> Site settings under the widget on the blog.
You will then see a pop-up window with your profile settings. Click Stop following this site and you will be removed from following the blog. If the blog doesn't have a Followers widget, you can still stop following the blog. To do so, click the gear icon on the right-hand side of your Reading List on your dashboard