Yes. I'm a libertarian that way.
You bring up one of the best points. We know for a fact people do it even when it's illegal (the last fifty years is a testament to that). Why not make some tax revenue, free up the prisons, and control it so only certain people can use it? I feel like shouting, "Duh," but I'll settle on typing it.
Thanks for the great question.