It's a matter of semantics more than anything else.
Matter is everything physical all around us. In fact, it's everything known to science, including anti-matter.
A physical or chemical substance is simply a particular matter configuration.
In daily language, however, matters of "substance" have depth of meaning, while the rest "doesn't matter" ;)