I have only visited Duluth once. However, when I visited I was taken to Fitger's Brewhouse. It had a great atmosphere for a casual dinner and seemed to be quite family-friendly. I ate the homemade veggie burger (as recommended by my host, who happened to also order it although he eats beef!), and it was delicious. It's also worth trying one of their house beers.