Generally speaking, you have to pay unless you get a court order to withhold all or a portion of your rent until the problem is solved.
There is probably some form of landlord/tenant bureau in your area; and, I highly recommend you pay them a visit. Tenancy laws vary from state-to-state, province-to-province, etc. While most places enact similar laws to each other, there are differences; and, these differences could win or lose your case for you.
I used to work as an Information Officer in British Columbia interpreting legislation for clients; and, helping them to understand their rights, obligations, privileges and duties under the Landlord/Tenant Act. Trust me - find an office near you.