Perhaps you started following too many people too quickly? that can do it. Also you don't have very many hubs. Try writing more hubs that are very unique and high quality. If you follow others do so a little at a time. Also know that hubscores go up and down naturally all the time and it's due to a variety of factors.