I think it depends on how you celebrate it. Just saying Merry Christmas every year is kind of a celebration. But, getting together with family, and making a big deal out of it, is something our family rarely does to begin with. Mainly because we are all scattered throughout the state now, and don't have a whole lot of money to travel, and nobody can ever agree on who should host it.
So, our family has not had a big celebration in years. But, when we were kids, we celebrated Christmas with the relatives every year. and there were so many people on my moms side of the family, that we needed to rent a hall to have it. Usually with 200 to 300 people.