Well, maybe that's the reason I don't have many friends.. (just 1 actually), but when I was in a situation like that I just said "Look, I'm sorry but you can't come here every day cause I have things to do, and a life. I grant you access to my home on saturday and wednesday, and you need to call one hour in advance to let me know if you're coming".
However there is a smarter solution, if you're the type of person who avoids direct confrontation. Get a mutual friend to link this question to the annoying friend and when he reads it, he will never talk to you again. (Unless he's without any pride, than it's probably better to just give him the rules)