No one beats Marv Albert. He was the voice of both the Knicks and the Rangers for years. He was brilliant with Walt Frazier and John Andriese on Knick broadcasts. Nationally, Al Michaels is the gold standard.
Having grown up in NYC, I have some biases, but for Yankee telecasts I really liked Bill White and Frank Messer. Not much on Rizzuto though, but he was fun. Nationally, I loved Vin Scully and before that Garagiola/Kubek. For the NFL, it's Summerall. But before that I always loved the late Charlie Jones with Len Dawson.
The only play by play guy who I would turn off is Bob Costas. Maybe he's an easy target. Not sure why. Even on Olympics telecasts, he drives me a little nuts. But I remember him on Game of the Week (NBC), and I did not like him.