There is no right or wrong here. Everything in our world is subjective, so if you're feeling a little guilty about spending...take a good look at your financial situation and determine if you are spending your money really the way you want.
if you are saving enough for your needs, then whatever else you do with your money is your business.
Life should not be only about work. Enjoy it, too.